Skip to content

[codex] Scrape Young signup events#15

Merged
tiankaima merged 1 commit into
masterfrom
young-events-scraper
Jul 5, 2026
Merged

[codex] Scrape Young signup events#15
tiankaima merged 1 commit into
masterfrom
young-events-scraper

Conversation

@tiankaima

Copy link
Copy Markdown
Member

Summary

  • Add a Young signup event scraper that logs into the SignUp app with Playwright, extracts the Young access token, then fetches event APIs through HTTP requests.
  • Store active events every run and reuse cached ended events when the upstream ended total has not changed.
  • Add dynamic JSON response storage so the full upstream event payload, including nested fields, is preserved in SQLite.

Validation

  • uv run python -m unittest discover -s tests -p 'test_*.py'
  • uv run ruff check .
  • uv run python -m compileall main.py src tests
  • git diff --check
  • Clean local uv run python main.py --young: 17 active events, 2641 ended events, refreshed=True, SQLite PRAGMA quick_check = ok
  • Incremental local uv run python main.py --young: 17 active events, 2641 ended events, refreshed=False, SQLite PRAGMA quick_check = ok

@tiankaima
tiankaima merged commit 91c5247 into master Jul 5, 2026
3 checks passed
@tiankaima
tiankaima deleted the young-events-scraper branch July 5, 2026 10:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant