Metaflow, can be instantiated simply with
pathspec. Note that also this operation is subject to the current namespace, as explained in Organizing Results; in short, you will not be able to access a Flow that is not the current namespace; the error message returned will make it clear whether an object exists and is not in the namespace or does not exist at all.
DataArtifactobject whose parent is a
DataArtifactis a container object for the actual value. Besides the value,
DataArtifactincludes metadata about the artifact, such as its time of creation.
.dataproperty returns a container which has all artifacts produced by the task as attributes.
self.xin the step
aof the run
2of the flow
tags: tags assigned to the object
created_at: creation timestamp
parent: parent object
pathspec: object fully qualified name
path_components: list containing the elements in
runs()method. See Tagging for more detail.
Flowhas two additional properties related to determining the latest run for the flow. Note that any
Runreturned will be in the current namespace.
Runof the latest run whether or not it has completed or has been successful
Runof the latest successful (and therefore completed) run.
steps()method. See Tagging for more detail.
Runalso has a few additional properties to make it easy to access commonly used information:
data: A quick way to access the
dataobject of the end task of this run. In other words, this is the quickest way to access the data produced at the end of the flow.
successful: A boolean indicating whether or not the run completed successfully. Note that this will return
Falseif the run has not completed (ie: is still in progress).
finished: A boolean indicating whether or not the run completed. The returned value will be
Truewhether or not the run was successful.
finished_at: A datetime object indicating the completion time of the run. This will be
Noneif the run has not completed
code: In certain circumstances, the code used for this run is saved and persisted; this allows you to access this code.
end_task: A quick access to the
Taskobject of the last step in the run.
Steptypically has a single
Task. A Step will have multiple
Taskobjects as its children if it is a
Taskwill correspond to a single execution of the
tasks()method. See Tagging for more detail.
Stephas a few additional properties as well:
task: Convenience method to return the unique
Taskassociated with this
Step. If a
Stephas more than one
Task, this will return any of them (no order guaranteed).
finished_at: A datetime object indicating the completion time of the step. A step is complete when all its tasks are complete.
Taskis the actual unit of execution in Metaflow, these objects contain the richest set of properties:
successful: A boolean indicating whether or not this
finished: A boolean indicating whether or not this
exception: If an exception was raised by this
Task(ie: it did not complete successfully), it will be contained here.
finished_at: A datetime object indicating the completion time of this
stdout: A string containing the standard output of this
stderr: A string containing the standard error of this
code: The code used to execute this
Task, if available.
.metaflowdirectory on your filesystem) and a remote mode.