HPC Environment Advanced Setup
The Advanced Configuration setup option provides many different options for types and quantity of storage and compute nodes, complexity of compute group and scheduler configurations.
Follow the steps below to create an Advanced Configuration Environment:
- On the Environment Overview main screen, click the “+” button at the top left to create a new environment.
- Use the pulldown menu to select options for Environment Region, Instance SSH Key, Environment Availability Zone and CloudyCluster Version. The newest version of CloudyCluster is always recommended.
- Enter a Name for your Environment.
- Select the Advanced Configuration link at the bottom of the screen.
- If you want to specify a fixed number of compute group instances, select the Fixed Compute Group check box and enter a compute group name.
- Select the compute instance type from the pulldown menu and enter the number of dedicated compute instances.
- Enter a scheduler name and select scheduler type and instance type from the pulldown menus.
- Select a Compute Volume Type.
- If you want to set up a Dynamic Job-Scaling compute group instead of a fixed size compute group, select the Job-Scaling Scheduler and Compute Group with CCQ check box.
If you select the Job-Scaling Scheduler and Compute Group with CCQ check box, the Fixed Compute Group option will be automatically deselected. You can add a fixed compute group once the Environment is up.
- If you want to use OrangeFS, select the Parallel Storage check box and select your Storage Instance Type from the pulldown menu. You may opt to use Amazon’s EFS file system if it is available in your selected region.
- Enter the number of working storage instances and the number of failover instances.
- Select the Working Volume Type. The default file system is OrangeFS.
The number of failover instances defaults to 10% of the number of storage instances or to 1, whichever is greater. You may override this default with any number larger than 10% of the number of storage instances.
- Enter the total storage size in gigabytes. This storage amount will be divided among the storage instances.
- Select the check box if you want to enable EBS Encryption. For more information, see Amazon EBS Encryption.
- Select the number of volumes per instance.
- Select the Login Instance check box. Enter an Instance Name, select your Login Instance Type, and select your Login Volume Type. This is required for WebDAV, and it functions as the “head-node” of the environment, providing a way to submit jobs and access internal nodes from the Internet without having to access the scheduler and other internal instances via the Control Node terminal window.
- Select your NAT Instance Type, or accept the default.
- If you want to use EFS as your file system, select the Amazon EFS check box and enter an EFS name.
EFS is not available in some regions. If unavailable, you will see the notification *** EFS unavailable for region *** and the EFS selection options will be disabled.
- If using Amazon EFS, you may enable Shared Home Directories and Shared Software Installation Mount. For Shared Software Installation Mount, you must assign a SSW name.
- If you want to add an Amazon S3 bucket for storage, select the Amazon S3 Buckets check box and enter a name for the S3 bucket to be created. You may also opt to enforce S3 object encryption.
- Click the Next arrow to proceed.
- You will be presented with a Final Review which summarizes the environment components you have chosen and the total running cost for this environment, apart from network egress.
- Enter a network CIDR representing an IP address range that is permitted to access your environment.
You may enter “0.0.0.0/0” here if you do not know your address range. This will make the environment accessible to the Internet, but will allow you to use CloudyCluster. Private IP addresses (i.e., 192.x.x.x/x or 10.x.x.x/x) are not valid CIDRs. You can also change this later in the AWS console. It is recommended that production environments have restricted access.
- After you have carefully reviewed your environment configuration, click the Create Environment button to start spinning up your cluster.