{"status":"published","benchmark":"machine-choice","report_id":"b3faeaef1e1df1d0","started_at":"2026-10-27T12:00:24.977781+00:00","finished_at":"2026-10-27T12:10:41.642671+00:00","reason":"first report","headline":"In web search, web.tollkit.dev took 37% of 27 picks. In chain data, agent402.tools took 65% of 26 picks; the first slot gained 14 points.","categories":{"web_search":{"tasks":[{"task":"search the web for recent results","decisions":9,"chose_none":0,"offers":[{"host":"web.tollkit.dev","service":"Web Search API (Google results)","resource":"https://web.tollkit.dev/search","price_usd":0.003,"payers_30d":4,"calls_30d":9,"share":{"wins":5,"n":9,"rate":0.5556,"ci95":[0.2667,0.8112]}},{"host":"webtools402.176-109-107-191.sslip.io","service":"web-search","resource":"https://webtools402.176-109-107-191.sslip.io/search","price_usd":0.003,"payers_30d":7,"calls_30d":12,"share":{"wins":2,"n":9,"rate":0.2222,"ci95":[0.0632,0.5474]}},{"host":"api.kadec0.xyz","service":"Web Search (SERP)","resource":"https://api.kadec0.xyz/v1/serp","price_usd":0.05,"payers_30d":7,"calls_30d":570,"share":{"wins":2,"n":9,"rate":0.2222,"ci95":[0.0632,0.5474]}},{"host":"agent-data-tools.revmesh2074.workers.dev","service":"Web search results","resource":"https://agent-data-tools.revmesh2074.workers.dev/search","price_usd":0.01,"payers_30d":2,"calls_30d":2,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"agent-data-tools.revmesh2074.workers.dev","service":"Web search results","resource":"https://agent-data-tools.revmesh2074.workers.dev/v1/search","price_usd":0.01,"payers_30d":1,"calls_30d":1,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"x402tap.com","service":"x402 Web Search","resource":"https://x402tap.com/api/web-search","price_usd":0.015,"payers_30d":5,"calls_30d":25,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}}]},{"task":"Google search results as JSON","decisions":9,"chose_none":0,"offers":[{"host":"web.tollkit.dev","service":"Web Search API (Google results)","resource":"https://web.tollkit.dev/search","price_usd":0.003,"payers_30d":4,"calls_30d":9,"share":{"wins":5,"n":9,"rate":0.5556,"ci95":[0.2667,0.8112]}},{"host":"serp402.com","service":"serp402","resource":"https://serp402.com/api/v1/search","price_usd":0.05,"payers_30d":9,"calls_30d":373,"share":{"wins":3,"n":9,"rate":0.3333,"ci95":[0.1206,0.6458]}},{"host":"agdata.shveik.dev","service":"agdata","resource":"https://agdata.shveik.dev/x402/google-search","price_usd":0.03005,"payers_30d":4,"calls_30d":10,"share":{"wins":1,"n":9,"rate":0.1111,"ci95":[0.0199,0.435]}},{"host":"websearch.use.x402atlas.com","service":"Web Search, News & Page Reader","resource":"https://websearch.use.x402atlas.com/google-search","price_usd":0.108,"payers_30d":1,"calls_30d":3,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"search.openverbs.com","service":"Web Search (Google SERP)","resource":"https://search.openverbs.com/v1/web","price_usd":0.01,"payers_30d":3,"calls_30d":17,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"google-patents.use.x402atlas.com","service":"Google Patents Search & Data","resource":"https://google-patents.use.x402atlas.com/search","price_usd":0.02,"payers_30d":3,"calls_30d":8,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}}]},{"task":"search news from the last day","decisions":9,"chose_none":0,"offers":[{"host":"api.agentstools.dev","service":"web-news","resource":"https://api.agentstools.dev/search/news","price_usd":0.003,"payers_30d":13,"calls_30d":148,"share":{"wins":7,"n":9,"rate":0.7778,"ci95":[0.4526,0.9368]}},{"host":"search.openverbs.com","service":"News search","resource":"https://search.openverbs.com/v1/news","price_usd":0.01,"payers_30d":3,"calls_30d":117,"share":{"wins":1,"n":9,"rate":0.1111,"ci95":[0.0199,0.435]}},{"host":"agentsvc.io","service":"News Search API","resource":"https://agentsvc.io/api/v1/proxy/news-search","price_usd":0.0065,"payers_30d":7,"calls_30d":33,"share":{"wins":1,"n":9,"rate":0.1111,"ci95":[0.0199,0.435]}},{"host":"x402-seller-pmlm.onrender.com","service":"News Search & Headlines","resource":"https://x402-seller-pmlm.onrender.com/news","price_usd":0.004,"payers_30d":5,"calls_30d":8,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"agent402.tools","service":"News search","resource":"https://agent402.tools/api/search-news","price_usd":0.01,"payers_30d":3,"calls_30d":10,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}}]}],"decisions":27,"chose_none":0,"by_host":[{"host":"web.tollkit.dev","picks":10,"shown":18,"share":{"wins":10,"n":18,"rate":0.5556,"ci95":[0.3372,0.7544]}},{"host":"api.agentstools.dev","picks":7,"shown":9,"share":{"wins":7,"n":9,"rate":0.7778,"ci95":[0.4526,0.9368]}},{"host":"serp402.com","picks":3,"shown":9,"share":{"wins":3,"n":9,"rate":0.3333,"ci95":[0.1206,0.6458]}},{"host":"api.kadec0.xyz","picks":2,"shown":9,"share":{"wins":2,"n":9,"rate":0.2222,"ci95":[0.0632,0.5474]}},{"host":"webtools402.176-109-107-191.sslip.io","picks":2,"shown":9,"share":{"wins":2,"n":9,"rate":0.2222,"ci95":[0.0632,0.5474]}},{"host":"agdata.shveik.dev","picks":1,"shown":9,"share":{"wins":1,"n":9,"rate":0.1111,"ci95":[0.0199,0.435]}},{"host":"agentsvc.io","picks":1,"shown":9,"share":{"wins":1,"n":9,"rate":0.1111,"ci95":[0.0199,0.435]}},{"host":"search.openverbs.com","picks":1,"shown":18,"share":{"wins":1,"n":18,"rate":0.0556,"ci95":[0.0099,0.2576]}},{"host":"agent-data-tools.revmesh2074.workers.dev","picks":0,"shown":18,"share":{"wins":0,"n":18,"rate":0.0,"ci95":[0.0,0.1759]}},{"host":"agent402.tools","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"google-patents.use.x402atlas.com","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"websearch.use.x402atlas.com","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"x402-seller-pmlm.onrender.com","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"x402tap.com","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}}],"picks_by_host":{"web.tollkit.dev":10,"api.agentstools.dev":7,"api.kadec0.xyz":2,"serp402.com":3,"search.openverbs.com":1,"webtools402.176-109-107-191.sslip.io":2,"agdata.shveik.dev":1,"agentsvc.io":1},"by_position":{"1":{"wins":6,"n":27,"rate":0.2222,"ci95":[0.1061,0.4076],"if_position_didnt_matter":0.1778},"2":{"wins":10,"n":27,"rate":0.3704,"ci95":[0.2153,0.5577],"if_position_didnt_matter":0.1778},"3":{"wins":3,"n":27,"rate":0.1111,"ci95":[0.0385,0.2806],"if_position_didnt_matter":0.1778},"4":{"wins":3,"n":27,"rate":0.1111,"ci95":[0.0385,0.2806],"if_position_didnt_matter":0.1778},"5":{"wins":4,"n":27,"rate":0.1481,"ci95":[0.0592,0.3248],"if_position_didnt_matter":0.1778},"6":{"wins":1,"n":18,"rate":0.0556,"ci95":[0.0099,0.2576],"if_position_didnt_matter":0.1667}},"first_position_effect":0.0444,"by_member":{"Panelist D":{"decisions":9,"chose_none":0,"picks":{"api.agentstools.dev":3,"web.tollkit.dev":2,"serp402.com":2,"webtools402.176-109-107-191.sslip.io":1,"api.kadec0.xyz":1}},"Panelist B":{"decisions":9,"chose_none":0,"picks":{"web.tollkit.dev":4,"api.agentstools.dev":2,"api.kadec0.xyz":1,"serp402.com":1,"search.openverbs.com":1}},"Panelist C":{"decisions":9,"chose_none":0,"picks":{"web.tollkit.dev":4,"api.agentstools.dev":2,"webtools402.176-109-107-191.sslip.io":1,"agdata.shveik.dev":1,"agentsvc.io":1}}},"by_persona":{"budget":[["web.tollkit.dev",4],["api.agentstools.dev",3],["webtools402.176-109-107-191.sslip.io",2]],"fit":[["web.tollkit.dev",4],["search.openverbs.com",1],["agdata.shveik.dev",1]],"proven":[["api.agentstools.dev",3],["api.kadec0.xyz",2],["serp402.com",2]]},"reasons":{"proven_usage":10,"task_fit":9,"price":8},"price":{"estimated":false,"why":"needs at least 30 decisions with prices; there were 27","decisions":27},"shock":{"vs_report":null,"index":null,"by_member":{},"flagged":[]},"proof_lift":{"settlement":{"pairs":7,"without":{"wins":3,"n":7,"rate":0.4286,"ci95":[0.1582,0.7495]},"with":{"wins":3,"n":7,"rate":0.4286,"ci95":[0.1582,0.7495]},"difference":{"diff":0.0,"ci95":[-0.4197,0.4197],"verdict":"inconclusive"},"switched_to_focal":1,"switched_away":1},"capture":{"pairs":9,"without":{"wins":3,"n":9,"rate":0.3333,"ci95":[0.1206,0.6458]},"with":{"wins":2,"n":9,"rate":0.2222,"ci95":[0.0632,0.5474]},"difference":{"diff":-0.1111,"ci95":[-0.4617,0.2775],"verdict":"inconclusive"},"switched_to_focal":0,"switched_away":1},"receipts":{"pairs":9,"without":{"wins":1,"n":9,"rate":0.1111,"ci95":[0.0199,0.435]},"with":{"wins":3,"n":9,"rate":0.3333,"ci95":[0.1206,0.6458]},"difference":{"diff":0.2222,"ci95":[-0.1653,0.5477],"verdict":"inconclusive"},"switched_to_focal":2,"switched_away":0},"any":{"pairs":25,"without":{"wins":7,"n":25,"rate":0.28,"ci95":[0.1428,0.4758]},"with":{"wins":8,"n":25,"rate":0.32,"ci95":[0.1721,0.5159]},"difference":{"diff":0.04,"ci95":[-0.2054,0.2791],"verdict":"inconclusive"},"switched_to_focal":3,"switched_away":2}}},"chain_data":{"tasks":[{"task":"token balances of a wallet","decisions":9,"chose_none":0,"offers":[{"host":"agent402.tools","service":"Wallet token balances (indexed)","resource":"https://agent402.tools/api/wallet-balances","price_usd":0.002,"payers_30d":3,"calls_30d":10,"share":{"wins":9,"n":9,"rate":1.0,"ci95":[0.7009,1.0]}},{"host":"agent402.tools","service":"Token balances (named contracts)","resource":"https://agent402.tools/api/token-balances","price_usd":0.002,"payers_30d":3,"calls_30d":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"agent-data-tools.revmesh2074.workers.dev","service":"Base wallet balances","resource":"https://agent-data-tools.revmesh2074.workers.dev/wallet","price_usd":0.005,"payers_30d":3,"calls_30d":3,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"x402-seller-pmlm.onrender.com","service":"Wallet Balance","resource":"https://x402-seller-pmlm.onrender.com/balance","price_usd":0.003,"payers_30d":4,"calls_30d":6,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"agent-data-tools.revmesh2074.workers.dev","service":"Wallet portfolio value","resource":"https://agent-data-tools.revmesh2074.workers.dev/wallet/portfolio","price_usd":0.005,"payers_30d":2,"calls_30d":4,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"webtools402.176-109-107-191.sslip.io","service":"onchain-wallet-balances","resource":"https://webtools402.176-109-107-191.sslip.io/wallet/balances","price_usd":0.005,"payers_30d":3,"calls_30d":3,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}}]},{"task":"transaction history of a wallet","decisions":8,"chose_none":0,"offers":[{"host":"agent402.tools","service":"Wallet transaction history","resource":"https://agent402.tools/api/wallet-transactions","price_usd":0.002,"payers_30d":3,"calls_30d":9,"share":{"wins":8,"n":8,"rate":1.0,"ci95":[0.6756,1.0]}},{"host":"chain.intel.rallylive.ca","service":"wallet-token-transfers","resource":"https://chain.intel.rallylive.ca/wallet/transfers","price_usd":0.01,"payers_30d":1,"calls_30d":1,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}},{"host":"x402-wallet-profile-api-production.up.railway.app","service":"Base Wallet Profile","resource":"https://x402-wallet-profile-api-production.up.railway.app/wallet/:address","price_usd":0.01,"payers_30d":2,"calls_30d":4,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}},{"host":"onchaincheck.dev","service":"Solana Onchain Data","resource":"https://onchaincheck.dev/solana/wallet","price_usd":0.005,"payers_30d":2,"calls_30d":2,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}},{"host":"x402-gateway.blackwoodstate8.workers.dev","service":"Multi-chain Wallet Balance","resource":"https://x402-gateway.blackwoodstate8.workers.dev/v1/wallet-portfolio","price_usd":0.003,"payers_30d":3,"calls_30d":7,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}},{"host":"402.com.tr","service":"Wallet Age & Activity","resource":"https://402.com.tr/api/x402/wallet-summary","price_usd":0.03,"payers_30d":3,"calls_30d":5,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}}]},{"task":"price of a token on a DEX","decisions":9,"chose_none":0,"offers":[{"host":"chain.tollkit.dev","service":"Crypto Token Price (USD)","resource":"https://chain.tollkit.dev/chain/price","price_usd":0.001,"payers_30d":8,"calls_30d":13,"share":{"wins":7,"n":9,"rate":0.7778,"ci95":[0.4526,0.9368]}},{"host":"api.marketintelligenceapi.com","service":"Token price by contract address","resource":"https://api.marketintelligenceapi.com/api/v1/intelligence/token-price/:address","price_usd":0.001,"payers_30d":1,"calls_30d":2,"share":{"wins":2,"n":9,"rate":0.2222,"ci95":[0.0632,0.5474]}},{"host":"chain.intel.rallylive.ca","service":"token-price","resource":"https://chain.intel.rallylive.ca/token/price","price_usd":0.01,"payers_30d":1,"calls_30d":1,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"agent-data-tools.revmesh2074.workers.dev","service":"Crypto price and token price","resource":"https://agent-data-tools.revmesh2074.workers.dev/price/token","price_usd":0.003,"payers_30d":2,"calls_30d":7,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"agent-data.centorprat.workers.dev","service":"DEX Token Market Snapshot","resource":"https://agent-data.centorprat.workers.dev/tools/dex-token-market-snapshot","price_usd":0.015,"payers_30d":2,"calls_30d":3,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"x402-gateway.blackwoodstate8.workers.dev","service":"Blackwood State Token Price","resource":"https://x402-gateway.blackwoodstate8.workers.dev/v1/token-price","price_usd":0.002,"payers_30d":3,"calls_30d":8,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}}]}],"decisions":26,"chose_none":0,"by_host":[{"host":"agent402.tools","picks":17,"shown":26,"share":{"wins":17,"n":26,"rate":0.6538,"ci95":[0.4622,0.8059]}},{"host":"chain.tollkit.dev","picks":7,"shown":9,"share":{"wins":7,"n":9,"rate":0.7778,"ci95":[0.4526,0.9368]}},{"host":"api.marketintelligenceapi.com","picks":2,"shown":9,"share":{"wins":2,"n":9,"rate":0.2222,"ci95":[0.0632,0.5474]}},{"host":"402.com.tr","picks":0,"shown":8,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}},{"host":"agent-data-tools.revmesh2074.workers.dev","picks":0,"shown":27,"share":{"wins":0,"n":27,"rate":0.0,"ci95":[0.0,0.1246]}},{"host":"agent-data.centorprat.workers.dev","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"chain.intel.rallylive.ca","picks":0,"shown":17,"share":{"wins":0,"n":17,"rate":0.0,"ci95":[0.0,0.1843]}},{"host":"onchaincheck.dev","picks":0,"shown":8,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}},{"host":"webtools402.176-109-107-191.sslip.io","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"x402-gateway.blackwoodstate8.workers.dev","picks":0,"shown":17,"share":{"wins":0,"n":17,"rate":0.0,"ci95":[0.0,0.1843]}},{"host":"x402-seller-pmlm.onrender.com","picks":0,"shown":9,"share":{"wins":0,"n":9,"rate":0.0,"ci95":[0.0,0.2991]}},{"host":"x402-wallet-profile-api-production.up.railway.app","picks":0,"shown":8,"share":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]}}],"picks_by_host":{"agent402.tools":17,"chain.tollkit.dev":7,"api.marketintelligenceapi.com":2},"by_position":{"1":{"wins":8,"n":26,"rate":0.3077,"ci95":[0.165,0.4999],"if_position_didnt_matter":0.1667},"2":{"wins":3,"n":26,"rate":0.1154,"ci95":[0.04,0.2898],"if_position_didnt_matter":0.1667},"3":{"wins":0,"n":26,"rate":0.0,"ci95":[0.0,0.1287],"if_position_didnt_matter":0.1667},"4":{"wins":3,"n":26,"rate":0.1154,"ci95":[0.04,0.2898],"if_position_didnt_matter":0.1667},"5":{"wins":4,"n":26,"rate":0.1538,"ci95":[0.0615,0.3353],"if_position_didnt_matter":0.1667},"6":{"wins":8,"n":26,"rate":0.3077,"ci95":[0.165,0.4999],"if_position_didnt_matter":0.1667}},"first_position_effect":0.141,"by_member":{"Panelist D":{"decisions":8,"chose_none":0,"picks":{"agent402.tools":5,"chain.tollkit.dev":3}},"Panelist B":{"decisions":9,"chose_none":0,"picks":{"agent402.tools":6,"chain.tollkit.dev":2,"api.marketintelligenceapi.com":1}},"Panelist C":{"decisions":9,"chose_none":0,"picks":{"agent402.tools":6,"chain.tollkit.dev":2,"api.marketintelligenceapi.com":1}}},"by_persona":{"budget":[["agent402.tools",6],["chain.tollkit.dev",3]],"fit":[["agent402.tools",5],["api.marketintelligenceapi.com",2],["chain.tollkit.dev",1]],"proven":[["agent402.tools",6],["chain.tollkit.dev",3]]},"reasons":{"task_fit":16,"price":5,"proven_usage":5},"price":{"estimated":false,"why":"needs at least 30 decisions with prices; there were 26","decisions":26},"shock":{"vs_report":null,"index":null,"by_member":{},"flagged":[]},"proof_lift":{"settlement":{"pairs":9,"without":{"wins":9,"n":9,"rate":1.0,"ci95":[0.7009,1.0]},"with":{"wins":9,"n":9,"rate":1.0,"ci95":[0.7009,1.0]},"difference":{"diff":0.0,"ci95":[-0.2991,0.2991],"verdict":"inconclusive"},"switched_to_focal":0,"switched_away":0},"capture":{"pairs":9,"without":{"wins":3,"n":9,"rate":0.3333,"ci95":[0.1206,0.6458]},"with":{"wins":3,"n":9,"rate":0.3333,"ci95":[0.1206,0.6458]},"difference":{"diff":0.0,"ci95":[-0.378,0.378],"verdict":"inconclusive"},"switched_to_focal":0,"switched_away":0},"receipts":{"pairs":8,"without":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]},"with":{"wins":0,"n":8,"rate":0.0,"ci95":[0.0,0.3244]},"difference":{"diff":0.0,"ci95":[-0.3244,0.3244],"verdict":"inconclusive"},"switched_to_focal":0,"switched_away":0},"any":{"pairs":26,"without":{"wins":12,"n":26,"rate":0.4615,"ci95":[0.2876,0.6454]},"with":{"wins":12,"n":26,"rate":0.4615,"ci95":[0.2876,0.6454]},"difference":{"diff":0.0,"ci95":[-0.2531,0.2531],"verdict":"inconclusive"},"switched_to_focal":0,"switched_away":0}}}},"thin_tasks":[],"models":{"Panelist B":"hosted","Panelist C":"hosted","Panelist D":"hosted"},"models_changed":[],"previous_report":null,"proof_arm":true,"panel":[{"panelist":"Panelist B","kind":"hosted","status":"ran","decisions":36,"invalid":0},{"panelist":"Panelist C","kind":"hosted","status":"ran","decisions":36,"invalid":0},{"panelist":"Panelist D","kind":"hosted","status":"ran","decisions":36,"invalid":3},{"panelist":"Panelist A","kind":"hosted","status":"skipped"}],"cost":{"cap_usd":0.5,"model_spend_usd":0.3295,"decisions":108,"invalid":3},"licence":"CC BY 4.0","method":{"tasks":"The first 3 buyer-agent task phrasings per category from Agoranome's gap finder, the same every week.","offers":"The top 6 Bazaar search results per task, deduplicated, shown as listed; descriptions cut to 500 characters.","presentation":"Headless: each offer as JSON (price, networks, method, discovery metadata, 30-day usage), the way an x402 client reads it, with the task and a $1.00 spend cap.","layout":"One seeded shuffle per task, rotated one slot per trial so every offer visits every position; personas rotate; every panelist and arm sees identical layouts.","trials_per_task":3,"trials_per_member":{"Panelist B":3,"Panelist C":3,"Panelist D":3},"arms":["listed","proof_added"],"proof_arm":"In each trial one offer, drawn at random, gets one Fair Offer field added by the experimenter (it is not that seller's claim), rotating through settlement, pay on delivery (the same settlement enforced by an auth-capture escrow), receipts, public receipts, sample and pledge. Lift is its pick rate against the same trial without the field.","statistics":"Shares carry Wilson 95% intervals. Price elasticity comes from a conditional logit over log price, first position, log 30-day payers and output example. Proof lift counts only when Newcombe's interval for the difference excludes zero. The shock index is the total variation distance between this report's picks and the previous report's, in points; 25 or more is flagged.","neutrality":"Agoranome's own listings are run the same way when search returns them, and shown losing when they lose. No seller pays to be included or ranked.","budget":"Model spend capped at $0.50 per report.","licence":"Reports and raw trials are published under CC BY 4.0.","data_sharing":"At least one hosted provider on the panel may use the offers and tasks its panelists see to train or improve its models."},"number":1,"trials_url":"/machines/benchmark/trials.json?report=1","dataset_url":"/machines/benchmark/dataset.jsonl","shocks_url":"/machines/benchmark/shocks.json","shock_trend":[{"number":1,"report_id":"b3faeaef1e1df1d0","started_at":"2026-10-27T12:00:24.977781+00:00","reason":"first report","categories":{"web_search":{"index":null,"flagged":[]},"chain_data":{"index":null,"flagged":[]}}}],"reports":[{"number":1,"report_id":"b3faeaef1e1df1d0","started_at":"2026-10-27T12:00:24.977781+00:00","reason":"first report","headline":"In web search, web.tollkit.dev took 37% of 27 picks. In chain data, agent402.tools took 65% of 26 picks; the first slot gained 14 points."}]}