Episode 5: Hello AWS
Look Mom, We're in the Cloud.
This flow is a simple linear workflow that verifies your cloud configuration. The start
and end
steps will run locally, while the hello
step will run remotely. After configuring Metaflow to run in the cloud, data and metadata about your runs will be stored remotely. This means you can use the client to access information about any flow from anywhere.
You can find the tutorial code on GitHub
Showcasing:
- AWS Batch and the
@batch
decorator. - Using the Client API to access data artifacts generated remotely in a local notebook.
@retry
decorator.
Before playing this episode:
python -m pip install notebook
- This tutorial requires access to compute and storage resources in the cloud, which can be configured by
To play this episode:
cd metaflow-tutorials
python 05-helloaws/helloaws.py run
jupyter-notebook 05-helloaws/helloaws.ipynb
- Open helloaws.ipynb in your remote Sagemaker notebook