Skip to content

feat(s3): aws s3 source - add request payer support - #26028

Open
vibe wants to merge 1 commit into
vectordotdev:masterfrom
vibe:feature/s3-request-payer
Open

feat(s3): aws s3 source - add request payer support#26028
vibe wants to merge 1 commit into
vectordotdev:masterfrom
vibe:feature/s3-request-payer

Conversation

@vibe

@vibe vibe commented Aug 5, 2026

Copy link
Copy Markdown

Summary

Adds a request_payer option to the aws_s3 source. When set to requester, Vector includes the request payer on S3 GetObject calls so it can read objects from Requester Pays buckets.

Leaving the option unset keeps the current behavior.

This also includes the generated config docs, example configuration, tests, and a changelog update.

Vector configuration

sources:
  s3:
    type: aws_s3
    region: us-east-1
    request_payer: requester
    sqs:
      queue_url: https://sqs.us-east-1.amazonaws.com/123456789012/my-queue

How did you test this PR?

Tested locally.

Commands run:

cargo test --lib --no-default-features --features sources-aws_s3 sources::aws_s3
make check-fmt
make check-markdown
make check-changelog-fragments
make generate-docs
VECTOR_BIN=target/debug/vector make -C website validate-config-examples

Is this a breaking change?

  • Yes
  • No

Does this PR include user facing changes?

References


I guess on another note, I'm happy to expand the tests, but felt mocking to test the underlying conversion of the passed in option -> aws header....seemed a bit overkill and not our responsibility.

@vibe
vibe requested review from a team as code owners August 5, 2026 09:46
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

All contributors have signed the CLA ✍️ ✅
Posted by the CLA Assistant Lite bot.

@github-actions github-actions Bot added docs review on hold The documentation team reviews PRs only after a PR is approved by the COSE team. domain: sources Anything related to the Vector's sources domain: external docs Anything related to Vector's external, public documentation labels Aug 5, 2026
@vibe

vibe commented Aug 5, 2026

Copy link
Copy Markdown
Author

I have read the CLA Document and I hereby sign the CLA.

@vibe

vibe commented Aug 5, 2026

Copy link
Copy Markdown
Author

recheck

@vibe vibe changed the title feature(s3): aws s3 source - add request payer support feat(s3): aws s3 source - add request payer support Aug 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs review on hold The documentation team reviews PRs only after a PR is approved by the COSE team. domain: external docs Anything related to Vector's external, public documentation domain: sources Anything related to the Vector's sources

Projects

None yet

Development

Successfully merging this pull request may close these issues.

S3 Request Payer support

1 participant