Wrong product
Injected failure: agent trades the wrong product. Told to buy 50 of ETH-USD, the agent buys ETH-USDC: the order exists, on a product nobody asked for.
Mode wrong_product of the failure matrix, on one of its eight workflows. Each run below is the sandbox's scripted agent acting on the sandbox's fake systems of record under the injected failure, an oracle reading those systems' databases, and the verdict of engine 1.0.0 from the systems of record alone.
Last changed Markdown versionllms.txt
| Workflow | Agent reported | Oracle | CommitLayer | Why |
|---|---|---|---|---|
| Place a trade | success | FAIL | FAIL | No order on the intended product was created at the broker |
Place a trade
Scenario trade/wrong_product: agent trades the wrong product.
What the agent reported
The agent reported success. Its calls, and what it saw come back:
- GET /broker/products/ETH-USDC200
- POST /broker/orders200
- GET /broker/orders/ord_ETH-USDC_1200
- POST /crm/notes200
Agent notes: traded ETH-USDC where ETH-USD was requested.
What the systems of record showed
Records written after the action:
- broker.order_created on ETH-USDCorder_id=ord_ETH-USDC_1, side=BUY, quote_value=50, status=FILLED
- broker.order_filled on ETH-USDCorder_id=ord_ETH-USDC_1, side=BUY, filled_value=50, filled_size=0.01470588, average_filled_price=3400
- crm.note_added on ETH-USDCauthor=lab-agent, text=BUY 50.0 USD of ETH-USDC
The oracle, reading the databases directly: FAIL
missing broker.order_created; missing broker.order_filled; missing crm.note_added
Effects on a record the action never named: ETH-USDC:order_created.
The verdict and why
FAIL No order on the intended product was created at the broker
Outcome FAIL, policy FAIL; the oracle reads outcome FAIL, policy FAIL.
- expected effectNo order on the intended product was created at the brokerbroker.order_created observed within 10m of the action
- expected effectThe order did not fill: it was placed but no trade happenedbroker.order_filled observed within 10m of the action
- expected effectNo CRM note was addedcrm.note_added observed within 10m of the action
Reported as effects with no action behind them: ETH-USDC:note_added, ETH-USDC:order_filled, ETH-USDC:order_created.
Run it in the Failure Lab
The Failure Lab replays each run above: the agent's calls, the records the systems held and the verdict. No account is needed. The verdict comes from the production engine while you watch.
The sandbox in the app runs the exact scenario in your own workspace, as a verified action: