parameter_flow.R. To deploy a version to AWS Step Functions, simply source the
RStudioversion of the code or in a terminal run
step-functions createagain, it will create a new version of your flow on AWS Step Functions. The newest version becomes the production version automatically (due to the consistency guarantees provided by AWS Step Functions, it might be a couple of seconds before this happens). If you want to test on AWS Step Functions without interfering with a production flow, you can change the name of your class, e.g. from ParameterFlow to ParameterFlowStaging, and
step-functions createthe flow under a new name.
--max-workersoption. For instance,
step-functions create --max-workers 500allows 500 tasks to be executed concurrently for every foreach step.
run --max-workersthat is used to limit concurrency outside AWS Step Functions.
scheduledecorator. This flow is triggered hourly:
decoratorin one of the following ways:
decorator("schedule", weekly=True)runs the workflow on Sundays at midnight.
decorator("schedule", daily=True)runs the workflow every day at midnight.
decorator("schedule", hourly=True)runs the workflow every hour.