Metaflow has been used in production at Netflix since early 2018. The core Metaflow was open-sourced in December 2019. Some features of Metaflow are not available in open-source yet but we may open-source them later if there is sufficient external interest. These features are listed below.
Please click the link and comment / thumbs-up the corresponding GitHub issue if you want to see the feature open-sourced.
Netflix uses an internal DAG scheduler to orchestrate most modeling and ETL pipelines in production. Metaflow flows can be deployed to the production scheduler with a single command. A similar integration could be provided e.g. for AWS Step Functions (Github issue)
Support in-memory processing of large data sets (Github issue)
A Slack bot for Metaflow. Use it to ask questions about past runs (Github issue)