Episode 5: Hello AWS

Look Mom, We're in the Cloud.

This flow is a simple linear workflow that verifies your cloud configuration. The start and end steps will run locally, while the hello step will run remotely. After configuring Metaflow to run in the cloud, data and metadata about your runs will be stored remotely. This means you can use the client to access information about any flow from anywhere.

You can find the tutorial code on GitHub

Showcasing:

• AWS Batch and the @batch decorator.
• Using the Client API to access data artifacts generated remotely in a local notebook.
• @retrydecorator.

Before playing this episode:

1. python -m pip install notebook
2. This tutorial requires access to compute and storage resources in the cloud, which can be configured by
   1. Following the instructions here or
   2. Requesting a sandbox.

To play this episode:

1. cd metaflow-tutorials
2. python 05-helloaws/helloaws.py run
3. jupyter-notebook 05-helloaws/helloaws.ipynb
4. Open helloaws.ipynb in your remote Sagemaker notebook

Tutorials