KymiraCertified BI

Failure catalogue · The metric means something else · 20 of 51

OBSERVED FAILURE MODE

Gross, net, and total from one admin.

A single storefront backend can emit gross revenue, net revenue, and an order total, each computed over a different combination of discounts, returns, shipping, and tax. Accounting then adds its own net, and management adds another. One word, revenue, with several live meanings inside one company. The slide shows a figure and no basis at all.

What we saw

Meridian Journal Group pulls subscription and single-copy sales from one storefront admin. The export offers three revenues before finance opens its ledger: a gross figure, a net figure after discounts and returns, and a total carrying shipping and tax. A board slide took revenue from whichever column the builder saw first. Nothing failed. The tie ran clean against the column that was chosen, and the headline moved between decks whenever a different person rebuilt the page from the same export.

Why it passes a glance

The three columns are all real, all correct, and all reconcilable, so any check that ties a figure to its own column stays green. The difference between them reads as a period effect rather than as a definition change, especially quarter over quarter. Readers assume revenue means the one their own function uses, and every function uses a different one.

What addresses it

The metric-store skill keeps one entry per metric with its formula, unit, anchor, and the fork it settled, so revenue is computed from one stored definition instead of whichever column a page author picked. Principle 10, a metric without its definition is not a number, requires that stored definition to render beside the figure on every page, never in a tooltip or a methodology note.

Check your own file in two minutes

  1. List every revenue column the export actually contains, with the discounts, returns, shipping, and tax each one includes.
  2. Ask which column the last board figure came from, then check the answer against the file.
  3. Write the chosen definition into one stored entry and point every report at it.
  4. Print the basis beside the number on the page before the next review.

What this does not catch

Storing one definition stops the number drifting between builders. It does not settle which basis the business should use, and it cannot detect an export that quietly changes what a column includes between versions. A definition change needs its own marker on every chart that crosses the date.

Quick answers

Which revenue figure belongs on a board slide?
Whichever one the board has agreed to, stated on the slide. The failure is not the choice, it is an unlabelled figure that a different builder replaces with a different column next quarter without anyone noticing.
Should the report show all three revenue figures?
Show one as the headline with its basis beside it, and the others beneath it. Three unlabelled headline candidates on one page invites the reader to pick, which is the same failure moved downstream.
How do I stop the definition drifting later?
Keep it in one stored place the build reads, version changes instead of editing in place, and mark the changeover on every affected chart so a discontinuity is never mistaken for performance.

Nearby failures

Two churn definitions, 3.4 points apartThe metric means something elseThe definition that drifted between copiesThe metric means something elseSell-through's four denominatorsThe metric means something else

Last updated 2026-09-02 · Dylan, founder · one of 51 observed failure modes, every one seen in a real build or in our own audits, none invented.

Get the free skill → The doctrine All 51 failure modes