AWS S3

AWS S3 nodes let you manage objects (files) in Amazon S3 buckets. Each operation is a separate node.

All nodes require an AWS S3 connection configured with your IAM credentials and region.

Nodes

List Objects

List objects in an S3 bucket.

Field	Description	Notes
Bucket	S3 bucket name	Required
Prefix	Filter by key prefix (e.g., uploads/2024/)	Optional. Supports templates
Max Keys	Maximum objects to return	Default: 1000

Supports streaming — each object metadata is emitted individually to downstream nodes.

Download

Download an object from S3.

Field	Description	Notes
Bucket	S3 bucket name	Required
Key	Object key (path)	Required. Supports templates

Returns the object content and metadata.

Upload

Upload an object to S3.

Field	Description	Notes
Bucket	S3 bucket name	Required
Key	Destination object key	Required. Supports templates
Content	File content or data to upload	Required. Supports templates
Content Type	MIME type (e.g., application/json)	Optional

Delete

Delete an object from S3.

Field	Description	Notes
Bucket	S3 bucket name	Required
Key	Object key to delete	Required. Supports templates

Common Patterns

Archive Data to S3

1. DataStore Query — fetch records
2. Transform — convert to CSV or JSON format
3. S3 Upload — store in an archive bucket

Process Uploaded Files

1. Cron — periodic check
2. S3 List Objects — list new files in an input prefix
3. S3 Download — fetch each file
4. Transform — process the data
5. S3 Delete — remove processed files