DEV Community

Cover image for Run machine learning jobs on AWS with a single command
Miguel Jaques
Miguel Jaques

Posted on

Run machine learning jobs on AWS with a single command

Hey everyone,

My co-founder and I just launched Nimbo, a dead-simple CLI that allows you to run jobs on AWS as if you were running them locally. GitHub: https://github.com/nimbo-sh/nimbo. Docs: https://docs.nimbo.sh.

We decided to build this because we were frustrated with how cumbersome using AWS was, and we just wanted to be able to run jobs on AWS as easily as we run them locally. At the same time, we wanted to make use of cheap spot instances (on Nimbo, this is a single parameter). All in all, we didn't like the current user experience.

For this reason, we also provide many useful commands to make it faster and easier to work with AWS, such as easily checking prices, logging onto an instance, or syncing data to/from S3 (you can see some useful commands here).

Unlike other similar services, we are solely client-side, meaning that the code runs on your EC2 instances and data is stored in your S3 buckets (we don't have a server; all the infrastructure orchestration happens in the Nimbo package).

We have tons of ideas for Nimbo, such as one-command Jupyter notebooks on EC2, add docker support, and (my personal favorite) provide images with preloaded large datasets like ImageNet, so that you don't have to download and store it yourself - you simply spin the instance, and the dataset is available at /datasets.

We are happy to receive any feedback and suggestions you have.

Top comments (0)