Navigation :

Limits

AWS imposes default limits on services for an account in a specific region. If your CloudyCluster configuration exceeds AWS limits, your cluster will not spin up. See AWS Service Limits for more information or to request a limit increase.

Instance Limits are the most frequent one that can cause issues with CloudyCluster. In addition to instance limits, there are also limits on: VPCs, Subnets, Security Groups, VPC Peering Connections, etc… A complete list can be found here

AWS Trusted Advisor can be used to check the limits on any given account and region. For more information, see AWS Trusted Advisor.

What You Should Know Prior to starting your CloudyCluster setup, you should know the basic requirements for your HPC tasks. The size of your job and your desired time to results will determine the types of resources needed to run your job. If you don’t know the resources required, you can start with one of the CloudyCluster Quick Start configurations and try it out to get a feel for what you need to complete your job within your desired time frame.

Getting Started includes the following topics:

EC2 Key Pairs Launching the Initial Control Instance

AWS imposes default limits on services for all new projects and new accounts, and in specific regions. It is very important to check your current limits & limits prior to starting your CloudyCluster environment. Low limits are one of the more common issues clients encounter with CloudyCluster.

Check/Adjust Project limits

Below is a table outlining the minimum limits for each standard cluster size. This allows for a base cluster to be set up.

Size Persistent Disk SSD CPUs RAM VM Instances

Test 300GB 4 16GB 4

Small 2330GB 10 40GB 5

Medium 4400GB 80 320GB 5

Large 10400GB 112 450GB 7

XL 20610GB 176 710GB 11

Size	Persistent Disk SSD	CPUs	RAM	VM Instances
Test	300GB	4	16GB	4
Small	2330GB	10	40GB	5
Medium	4400GB	80	320GB	5
Large	10400GB	112	450GB	7
XL	20610GB	176	710GB	11

You will need to increase your limits to accommodate your actual workloads as well. To run jobs, your limits will have to be increased.

Fortunately, it is fairly simple to calculate and adjust limits. Read our blog post on this process to learn more.

Prior to starting your CloudyCluster setup, you should know the basic requirements for your HPC tasks. The size of your job and your desired time to results will determine the types and quantities of resources needed to run your job. Example: (n)nodes = x (n)tasks per node = y (n)CPUs or GPUs

If you don’t know the resources required, you can start with one of the CloudyCluster Quick Start configurations and try it out to get a feel for what you need to complete your job within your desired time frame. You may also contact CloudyCluster Services Team for guidance. support [@] cloudycluster.com