Overview

The Amazon S3 connector lets PipesHub ingest and search content from AWS-hosted file buckets. Ideal for media libraries, archives, and document stores, S3-based content becomes semantically accessible to agents and workflows.

How it works

Using access keys or IAM roles, PipesHub scans S3 buckets, reads object metadata, and indexes file content across formats. Bucket-level security settings govern access, and each file is processed using supported parsers (PDFs, text, audio, video, etc.).

Configure

• Provide AWS access key and secret or assume IAM role

• Enable the S3 connector and specify target buckets and prefixes

• Set file-type filters and sync frequency

• Control access based on IAM policies