How use I use Automatic Horizontal Scaling: Multi Nodes

With CloudJiffy PaaS, the hosting of your applications becomes truly flexible. In addition to automatic vertical scaling, CloudJiffy also lets you to increase / decrease the number of servers in your environment manually or automatically.

The process of manual scaling is fairly simple - open the environment topology wizard and use the appropriate “+” and “-” buttons or type the required number in the central panel. Also, you can use the slider, which automatically appears upon making any adjustment.

Tip:

  • You can automate horizontal scaling based on incoming load with the help of tunable triggers
  • You can use the initial (master) node of the layer as your storage server for sharing data within the whole layer
  • in case of scaling in (i.e decreasing the nodes number), the last container added to the layer is the first one to be removed (unless it is selected explicitly)

Next, you can select the required scaling mode from the appropriate drop-down list. Also, for additional details refer to the horizontal scaling spciefics section below.

Starting with the 5.5 platform version, the preferred scaling mode can be selected for new environments during creation, as well as adjusted for the existing ones through the topology wizard:

  • Stateless - simultaneously creates all new nodes from the base image template
  • Stateful - sequentially copies the file system of the master container into the new nodes

                   

The first option is comparatively faster, while the second one automatically copies all custom configurations. Herewith, during the initial layer creation, all of the nodes are created simultaneously to speed up the process (even for the stateful mode, as no customization has been applied yet).

While using the stateless mode, be aware of the absence of the following features on the new nodes within the layer:

  • deployments - the existing project contexts won’t be transferred
  • custom SSL - SSL certificates and configs won’t be copied
  • mount points - custom mounts will be moved only if the appropriate volume is configured
  • add-ons - any add-ons installed on the layer won’t be available
Tip: The transfer of custom files for the stateless mode can be done manually or configured via the Cloud Scripting automation (e.g. using the onBefore- and onAfterScaleOut events).

Based on these peculiarities, Cloudjiffy PaaS recommends (and applies by default) the stateful scaling mode for the load balancerapplication server, and VPS stacks. In case of necessity, you can manually redefine the scaling mode for your nodes at any time via the topology wizard.

The maximum number of the same-type servers within a single environment layer depends on a particular hosting provider's settings (usually this limit stands for 16 nodes). You can check the exact value within the Quotas & Pricing > Account Limits information frame.

All newly added servers are created at different hardware nodes, providing advanced reliability and high availability.


Each environment node group (layer) is provided with a dedicated name, which, if needed, can be manually adjusted. In case there are several instances inside, the layer name will be complemented with the xN label (where N is the actual node number).

Having several same-type nodes within a layer enables their synchronous management. Thus, all comprised containers can be simultaneously configured, inspected for logs and statistics, restarted, or redeployed through the corresponding icons.
 

In order to operate with a particular container separately, expand the layer’s string to see the full list of its nodes. Each of these containers is an isolated instance, which has a unique Node ID and can be accessed/configured apart from others. Herewith, the layer master node can be easily located due to the dedicated icon.
 

To facilitate interaction with numerous servers of the same type, CloudJiffy also allows marking a particular node with the appropriate label, e.g. to define master and slave instances in a DB cluster.

Just double-click at the default Node ID: xxx value (or hover over it to reveal a special pencil icon) and specify the desired alternative name.
 


More information on this labeling feature can be found in the Environment Aliases document.

While scaling different types of stacks, consider the following specifics:

  • upon scaling the application server instance, the load balancer node will be automatically added to the environment topology
  • if enabling the high-availability option for an application server, the obligatory required NGINX load balancer cannot be scaled horizontally (if several nodes of NGINX were available before, they will be automatically downscaled to a single instance)
  • upon scaling VPS nodes, each one is provided with a separate public IP address attached
  • Maven is the only node, which cannot be scaled horizontally (as there is no point in such an operation)

Now, you know how easy it is to horizontally scale instances in Cloudjiffy PaaS and aware of the operation specifics. Also, feel free to configure an automatic node scaling to smoothly overcome high load spikes without overpaying for unused resources.

The platform provides simple node management, where you just need to specify the required number of containers in a layer. Herewith, the removal process is done in the order opposite to the addition - i.e. the most recent containers are removed first. In case you need to delete some specific node, you can select the required one via:

  • the Horizontal Scaling section in the topology wizard - is accessible using the Change Environment Topology button next to the required environment

        

the dedicated Scaling Nodes form in the dashboard - is accessible using the Additionally > Scaling Nodes option next to the layer or Additionally > Delete next to the particular node

In the Scaling Nodes window, you can perform the following actions:

1. Add new nodes to the layer, using the + or Add New Node buttons.

         

Tip:

  • In case a high availability option is enabled for the layer (available for the Tomcat and TomEE application servers only), the nodes are added and removed in pairs.
  • The new nodes' icons represent the scaling mode of the layer - an empty container for stateless and a filled one for stateful.

2. Remove instances with the - and Delete (upon hovering over a particular node) buttons.

        

Tip:

  • The first node in the list is a so-called “master” of the layer (highlighted with a special icon) and can only be removed alongside the whole layer.

You can Undo the Deletion of the existing node during configuration. However, after applying changes, the instance will be deleted permanently.

3. When applying changes, Cloudjiffy PaaS automatically notify you to about all the potentially harmful actions that will be performed with your environment (if any). The list includes:

  • nodes restart notice
  • layers and separate nodes removal reminder
  • impact on existing NFS mounts

     

Before proceeding, ensure that the listed points won’t affect your application, and any crucial data (from the removed nodes) is safely backed up.


Was this article helpful?

mood_bad Dislike 0
mood Like 0
visibility Views: 13190