Skip to content

v0.1.3: Optimize upload performance with gzip compression - #5

Merged
akarineren merged 5 commits into
mainfrom
dev
Jul 27, 2026
Merged

v0.1.3: Optimize upload performance with gzip compression#5
akarineren merged 5 commits into
mainfrom
dev

Conversation

@akarineren

Copy link
Copy Markdown
Member

Summary

This release optimizes CLI upload performance and fixes critical data handling issues:

  • Performance: 3-4x faster uploads with gzip compression and increased batch size
  • Data integrity: Fix data loss bug where only 5000 events were uploaded regardless of queue size
  • Code quality: Improved event prioritization logic (pending > failed > rejected/duplicate)

Changes

Upload Optimization

  • Increase batch size from 1000 → 5000 events/request
  • Implement gzip compression on request bodies (70% bandwidth reduction)
  • Add server-side gzip decompression support
  • Separate handling of accepted/duplicate/rejected events

Data Structure Reorganization

  • Migrate from flat structure to hierarchical directories: config/, data/, state/
  • Auto-migration for existing installations
  • Improved file organization

Bug Fixes

  • Fix upload loop data loss: ensure ALL pending events are sent (was capping at 5000)
  • Proper event status prioritization in sync loop
  • Improved error handling with exponential backoff

Testing

  • ✅ All CLI tests passing
  • ✅ All Next.js tests passing
  • ✅ Backward compatible with non-compressed requests

…PI key paths

- Update test mock server to decompress gzip-encoded request bodies
- Fix API key file path tests to use config/ subdirectory
- Add Duplicate and Rejected fields to mock response to match new validation logic
- All tests now passing with gzip compression enabled
@akarineren
akarineren merged commit 6a1ab58 into main Jul 27, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant