CloudyCluster Overview
Recognizing the growing number of people needing High Performance Computing (HPC) and parallel AI computational resources, CloudyCluster was designed to decrease the time and simplify the effort required to create a parallel computation environment on demand. CloudyCluster allows anyone to quickly set up and configure an HPC environment on Amazon Web Services (AWS).
Simple Setup
CloudyCluster makes it easy to set up an HPC environment in the AWS cloud, including Compute, Working Storage, and Direct Data Access. Unlike most data center models, CloudyCluster and AWS are available 24/7/365, with no hardware and installation time. You can pause your environment whenever you are not running a job, so you pay only for the processing time you use and minimal storage fees when your environment is paused.
CloudyCluster quickly provisions compute instances with a wide selection of open HPC applications, dynamically configured for access to storage. All instances within a compute group are based on the same image and the same instance type.
You can create and manage your own CloudyCluster environment using a self-service, mobile-friendly web interface. The CloudyCluster step-by-step wizard makes the setup process a straightforward, painless experience from any device, at your desk or on the go.
CloudyCluster also automatically incorporates enhanced networking capabilities for supported instance types, resulting in higher performance and throughput, lower latency and lower jitter.
Collaboration
Designed with Collaboration in mind, CloudyCluster also supports invitation-based collaboration, providing simple tools to add users and grant permission levels within the basic interface. Collaboration is also supported by simple options to create and share Google folders.
Components
Your CloudyCluster Virtual Private Cloud (VPC) integrates the parallel file system OrangeFS, which provides parallel access to disk storage for applications running in a High Performance Computing environment, solving storage issues for Big Data and Data Intensive applications. In some AWS regions, the AWS Elastic File System (EFS) is also available on CloudyCluster. With CloudyCluster on AWS, organizations who do not own or have immediate access to large HPC environments can quickly and easily use OrangeFS to make the most of available data whenever needed.
The browser-based CloudyCluster application creates complete HPC environments in AWS for quick HPC processing with OrangeFS and CCQ. We streamline the complex AWS setup process, with options for your unique HPC needs:
- Parallel storage with OrangeFS
- Schedulers such as Torque and SLURM
- CCQ, a metascheduler that provides job-initiated elastic HPC
- WebDAV for native file access
- Compute instance images contain popular Open Source software packages
- Globus for site to site data transfers
- All combined by an intuitive web user interface plus restlike APIs for easy integration.