
GitHub built an Effective Tokens (ET) metric — weighting output tokens 4x and cache reads 0.1x with a per-model cost multiplier — to normalize cost across its agentic CI workflows, then used daily Auditor and Optimizer agents to prune unused MCP tools and replace MCP calls with deterministic gh CLI calls, cutting costs by up to 62% on some workflows while being transparent about the confounders (workload shifts, quality tradeoffs) that make interpreting agent KPIs genuinely hard.