Skip to content
All failure modes
Failure mode

Wrong product

Injected failure: agent trades the wrong product. Told to buy 50 of ETH-USD, the agent buys ETH-USDC: the order exists, on a product nobody asked for.

Mode wrong_product of the failure matrix, on one of its eight workflows. Each run below is the sandbox's scripted agent acting on the sandbox's fake systems of record under the injected failure, an oracle reading those systems' databases, and the verdict of engine 1.0.0 from the systems of record alone.

Synthetic demo data.

Last changed Markdown versionllms.txt

WorkflowAgent reportedOracleCommitLayerWhy
Place a tradesuccessFAILFAILNo order on the intended product was created at the broker

Place a trade

Scenario trade/wrong_product: agent trades the wrong product.

What the agent reported

The agent reported success. Its calls, and what it saw come back:

  • GET /broker/products/ETH-USDC200
  • POST /broker/orders200
  • GET /broker/orders/ord_ETH-USDC_1200
  • POST /crm/notes200

Agent notes: traded ETH-USDC where ETH-USD was requested.

What the systems of record showed

Records written after the action:

  • broker.order_created on ETH-USDC
    order_id=ord_ETH-USDC_1, side=BUY, quote_value=50, status=FILLED
  • broker.order_filled on ETH-USDC
    order_id=ord_ETH-USDC_1, side=BUY, filled_value=50, filled_size=0.01470588, average_filled_price=3400
  • crm.note_added on ETH-USDC
    author=lab-agent, text=BUY 50.0 USD of ETH-USDC

The oracle, reading the databases directly: FAIL

missing broker.order_created; missing broker.order_filled; missing crm.note_added

Effects on a record the action never named: ETH-USDC:order_created.

The verdict and why

FAIL No order on the intended product was created at the broker

Outcome FAIL, policy FAIL; the oracle reads outcome FAIL, policy FAIL.

  • expected effect
    No order on the intended product was created at the broker
    broker.order_created observed within 10m of the action
  • expected effect
    The order did not fill: it was placed but no trade happened
    broker.order_filled observed within 10m of the action
  • expected effect
    No CRM note was added
    crm.note_added observed within 10m of the action

Reported as effects with no action behind them: ETH-USDC:note_added, ETH-USDC:order_filled, ETH-USDC:order_created.

Run it in the Failure Lab

The Failure Lab replays each run above: the agent's calls, the records the systems held and the verdict. No account is needed. The verdict comes from the production engine while you watch.

The sandbox in the app runs the exact scenario in your own workspace, as a verified action: