Skip to content

feat(metrics): move the metrics program to the orchestrator sequence - #1129

Merged
gewenyu99 merged 12 commits into
posthog/metrics-programfrom
posthog/metrics-orchestrator
Aug 21, 2026
Merged

feat(metrics): move the metrics program to the orchestrator sequence#1129
gewenyu99 merged 12 commits into
posthog/metrics-programfrom
posthog/metrics-orchestrator

Conversation

@gewenyu99

@gewenyu99 gewenyu99 commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator

Stacked on #1102, verified live (see comment): routes metrics onto the orchestrator on pi with the metrics agent flow (PostHog/context-mill#355) — the binding routes only, every stage's model/effort is pinned context-mill side (model_pi/effort_pi: terra seed, sol tasks, luna report), and each task's metrics skill resolves to its platform variant through the menu's per-framework entries.

🤖 Generated with Claude Code

gewenyu99 and others added 2 commits August 21, 2026 11:22
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci ai-observability
  • /wizard-ci basic-integration
  • /wizard-ci mcp-analytics
  • /wizard-ci replay-vision
  • /wizard-ci revenue
  • /wizard-ci self-driving

Test an individual app:

  • /wizard-ci ai-observability/anthropic
  • /wizard-ci ai-observability/groq
  • /wizard-ci ai-observability/manual-capture
Show more apps
  • /wizard-ci ai-observability/openai
  • /wizard-ci ai-observability/openai-agents
  • /wizard-ci ai-observability/vercel-ai
  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/flutter
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci mcp-analytics/custom-dispatcher
  • /wizard-ci mcp-analytics/typescript-sdk
  • /wizard-ci replay-vision/javascript-node
  • /wizard-ci replay-vision/next-js
  • /wizard-ci replay-vision/react-vite
  • /wizard-ci revenue/stripe
  • /wizard-ci self-driving/astro
  • /wizard-ci self-driving/fastapi
  • /wizard-ci self-driving/nuxt
  • /wizard-ci self-driving/react-router
  • /wizard-ci self-driving/sveltekit

Results will be posted here when complete.

…ols for task agents

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…ck pins resolution through task inputs

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@gewenyu99
gewenyu99 changed the base branch from posthog/metrics-sol-binding to posthog/metrics-program August 21, 2026 16:49
gewenyu99 and others added 8 commits August 21, 2026 12:50
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…s the task when the pin never arrives

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… entries resolve the variant

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…e program's skill id

(cherry-picked from replay-vision-command 6d96dea)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…sk frontmatter models as designed

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…d in the flow frontmatter

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…framework-fix cherry-pick

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@gewenyu99

Copy link
Copy Markdown
Collaborator Author

Verification — six live runs on the final stack

Orchestrator on pi, stage models from the flow frontmatter (terra seed / sol verify+instrument / luna report), variants resolved through the menu's frameworks: entries (PostHog/context-mill#355). Per-task usage tables, costs, and full TUI frames live on the run PRs:

app fresh rerun on instrumented evidence
flask-jobqueue (stale SDK) 223s 125s — source no-op PostHog/wizard-workbench#3507
express-orders (no PostHog) 201s 108s — source no-op PostHog/wizard-workbench#3508
nextjs-storefront (posthog-js only) 150s 152s — +23 gap-fill PostHog/wizard-workbench#3509 / #3510

~$0.10–0.30 per run (sol at luna–terra bounds; terra+luna legs exact). All six chose the correct platform variant deterministically; reruns are honest no-ops or additive gap-fills.

@gewenyu99
gewenyu99 marked this pull request as ready for review August 21, 2026 19:59
@gewenyu99
gewenyu99 requested a review from a team as a code owner August 21, 2026 19:59
@gewenyu99
gewenyu99 merged commit eae2c3d into posthog/metrics-program Aug 21, 2026
12 checks passed
@gewenyu99
gewenyu99 deleted the posthog/metrics-orchestrator branch August 21, 2026 20:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant