AWS Template S3 bucket prefixes might not match defaults in `metaflow configure aws`
Author: dennismoeCreated Feb 5, 2025Updated Sep 6, 2026
I encountered a small issue.
The default S3 prefixes in the AWS Template might not match with the suggested S3 prefixes in metaflow configure aws
MetaflowDataStoreS3Url:
Description: Amazon S3 URL for Metaflow DataStore [METAFLOW_DATASTORE_SYSROOT_S3]
Value: !Sub "s3://${MetaflowS3Bucket}/metaflow"
MetaflowDataToolsS3Url:
Description: Amazon S3 URL for Metaflow DataTools [METAFLOW_DATATOOLS_S3ROOT]
Value: !Sub "s3://${MetaflowS3Bucket}/data"metaflow configure aws suggests metaflow/data as default prefix for METAFLOW_DATATOOLS_S3ROOT if the environment variable METAFLOW_DATATOOLS_S3ROOT isn't set already - what should not be assumed in my opinion.
Source: Netflix/metaflow