Icecream is a distributed computing task scheduler designed for high-performance computing environments. With this project, you can quickly provision the necessary infrastructure and set up the Icecream cluster on DigitalOcean.
Before you begin, ensure that you have the following prerequisites set up:
- A DigitalOcean account. You will need create an API Key in the dashboard.
- Terraform installed on your local machine.
Generate ssh key pair with
ssh-keygen -f ssh-key -C "icecream@digitalocean"Add the generated public key in DigitalOcean settings.
To deploy the Icecream cluster, follow these steps:
- Clone this repository to your local machine:
git clone https://github.com/santanamobile/do-icecream-cluster.git- Navigate to the project directory:
cd do-icecream-cluster- Initialize Terraform:
terraform init-
Configure DigitalOcean API credentials:
- Create a new file named
terraform.tfvarsin the project directory. - Add the following content to
terraform.tfvars, replacing the values with your DigitalOcean API token:
- Create a new file named
do_token = "YOUR_DIGITALOCEAN_API_TOKEN"- Review and customize the cluster configuration:
In the project directory, copy the file 'variables.tf.example' to 'variables.tf' Review the available variables and modify their values as needed. For example, you can adjust the region, droplet count (number of workers), droplet size, , Digital Ocean ssh key name and token.
- After the review, you'll be able to deploy the desired infrastructure to Digital Ocean cloud.
terraform plan -out=icecream.tfplan- Deploy the Icecream cluster:
terraform apply "icecream.tfplan"- Review the planned changes and confirm the deployment by entering
yeswhen prompted.
Terraform will now provision the required DigitalOcean resources, including droplets, networks, and other dependencies. This step requires approximately 5 minutes to finish.
- Once the deployment is complete, Terraform will output the IP addresses of the Icecream cluster control node and worker nodes. Make a note of these values as you will need them to connect and use the cluster.
With the Icecream scheduller and worker nodes up and running, you can ssh to the scheduler host and submit tasks to the cluster.
This project is a start point of another project, a server cluster to build yocto artefacts.
To remove the Icecream cluster and associated resources from DigitalOcean, run the following command in the project directory:
terraform destroyReview the planned changes and enter yes to confirm the destruction of the resources.
Please note that this action cannot be undone, and all resources provisioned by Terraform will be permanently deleted.
- Improve firewall rules.
Contributions to this project are welcome! If you find any issues or have suggestions for improvements, please open an issue or submit a pull request.
This project is licensed under the MIT License. Feel free to modify and use it according to your needs.