Refuse to act on the AI spend number until it is decomposed - one-time hardware out, recurring API in - then treat the remainder as usage discipline rather than a spend cap

August 19, 2026 at 8:03 PMoperationalmedium

Situation

Steve Wallace raised rising AI costs at the end of the Aug 18 Engineering Weekly Sync. Peter did not accept the number as presented. He said the AI costs finance is counting include one-time purchases like the giant chassis just bought from NVIDIA for the 200s, and: I do not want to get hung up on one-time costs. I care way more about the recurring cloud costs and making sure people are being smart there. He set a meeting with finance for Thursday in LA to decompose it, and named what the response will be once the number is clean: model-tier discipline (teaching people not to do every single thing with Fable and Opus - Sonnet is still there for a reason and still really good at some things), possibly monthly per-person budgets, and a quality bar on AI-assisted work. Nathan raised that copy-pasting a prompt in and the answer out adds no value; Peter closed it with: we should be holding each other accountable and not accepting work at that bar.

Reasoning

Peter will not let a metric drive a decision until he is satisfied the metric measures the thing being decided about. A capital purchase and a per-token API bill are different problems with different remedies, and a blended figure would have produced the wrong remedy - most likely a blunt spending freeze. Once decomposed, the recurring number is a behaviour problem rather than a procurement one, so the levers he reaches for are teaching and accountability rather than a cap. The quality bar is the same move in a different register: the risk of cheap AI output is not the token cost, it is engineers shipping answers they do not understand, and that gets fixed by managers refusing to accept the work, not by a budget line.

Additional Context

Kelly Wall had asked Peter that same afternoon to set aside time Thursday in LA with her and Chris Baek about budget and costs, noting spend for AI and equipment has skyrocketed the last couple of months and they want a sanity check plus a cash projection for the rest of the year - the same conflation of equipment and AI that Peter separated in the sync. Steve Wallace then posted the Datadog AI Costs dashboard into #eng-management, where Nathan hit an empty-data view because it defaults to a one-hour window; Steve changed the default to 6 months.

Observed Evidence

Direct quotes from the Peter-recorded Engineering Weekly Sync transcript. Corroborated by Kelly Walls same-day request in the Baek mpdm, which bundles AI and equipment together in exactly the way Peter refused to reason about, and by the #eng-management dashboard thread that followed within the hour.

Matching Patterns

50%
Demonstrate the Standard, Then Collect It(2 keyword matches, same category (operational))

Confidence Breakdown

32/35
Evidence
26/30
Pattern
18/20
Source
14/15
Corroboration

Reasoning Depth Analysis

Org Signal:A number arriving from finance does not automatically become an engineering constraint. Peter will take the question but will re-derive the number first. It also signals that AI is not being treated as a cost centre to squeeze - the framing is smarter usage, not less usage.
Who Affected:Every engineer using Claude or Codex, since the eventual answer is model-tier guidance and possibly per-person budgets rather than a blanket cut. Steve Wallace owns the instrumentation. Every manager on the call inherited the quality bar - not accepting copy-pasted AI output is a manager obligation, not an IC one. Kelly Wall and Chris Baek get a decomposed number Thursday instead of the blended one they asked about.
Precedent:Second instance in two days of the same move - yesterday Peter refused to debate the cause of the Rocky download reversal until the metric itself was validated. The rule forming is: before the organisation argues about why a number moved or what to do about it, establish that it is the right number.
Consequences:Real. Anthropic spend hit a 50k limit late the previous night per Steve, and Brady put the fleet on track for a billion tokens this week. The decomposition changes what gets cut, and the quality bar changes what managers accept in review.
Timing:Now because finance had just flagged it and asked for a cash projection, so a number was about to be turned into policy whether or not it was the right number. Peter inserted the decomposition ahead of the Thursday meeting rather than after it.

Related Context

🎥
Engineering Weekly Sync

fathom

Peter: some of the AI costs that finance is counting are like the giant chassis that we just purchased for the 200s from NVIDIA. And so I do not want to get hung up on one-time costs. I care way more about the recurring cloud costs and making sure people are being smart there.

🎥
Engineering Weekly Sync - quality bar

fathom

Peter: And we should be holding each other accountable and not accepting work at that bar.

💬
mpdm with Kelly Wall and Christopher Baek

slack

Kelly Wall: Spend for AI and equipment has skyrocketed the last couple of months and we want to do a sanity check with you and also be able to project cash needs for the rest of the year.

💬
#eng-management - Datadog AI Costs dashboard

slack

Steve Wallace posts the AI Costs Dashboard; can group by sub account name or model, Monthly vs Daily (Anthropic and Open AI). Note: Anthropic does not include the prepaid plans.

Outcome

Fully executed the week of 8/24 - per-report walkthroughs with Wolford, Nathan, Ryan and Justin each produced a different cause, which is what made the per-case remedy rule possible.

Rating: 4/5

Decision ID: 6226b8fd-b7ec-4266-9a5b-2e7cf1bb99de