Evidence before numbers
If a result cannot be rerun, it is not a benchmark.
FRB does not publish product-wide PnL, win-rate, inclusion, success, or latency figures without a reproducible dataset and method. Simulation output is an estimate for a defined state and input, not a live-performance record or a forecast of economic outcome.
Current evidence status
What would be required to publish a metric
| Metric | Minimum evidence | FRB status |
|---|---|---|
| RPC/WSS latency | Endpoint, region, transport, clock, sample count, percentiles, raw observations, and test time | No FRB-wide benchmark published |
| Bundle inclusion | Provider, network, target rules, observation window, accepted and landed definitions, and raw status records | No FRB-wide benchmark published |
| Simulation agreement | Fork source, block, state assumptions, transaction set, exclusions, and final receipts | No FRB-wide benchmark published |
| Strategy outcome | Reproducible strategy definition, all costs, failed paths, market window, sample selection, and raw data | Not represented as a product performance claim |
Reproducible measurement protocol
- 1Freeze the FRB release, configuration, dependency versions, and checksum.
- 2Define the network, endpoint, region, transport, hardware, and clock source.
- 3Publish the transaction or request shape and every inclusion or exclusion rule.
- 4Retain raw observations before aggregation and remove wallet or user identifiers.
- 5Report sample count, observation window, failures, and percentile methodology.
- 6Separate endpoint receipt, simulation success, inclusion, finality, and economic outcome.
- 7Publish limitations and enough inputs for an independent rerun.
Claims we do not publish
- Expected profit or monthly income
- Product-wide win or success rates
- Inclusion figures without provider status data
- Latency figures without location and transport context
- Competitor rankings without a common test method
Provider documentation
Provider APIs define receipt and status semantics. They do not establish FRB-wide performance.
Measure your own endpoint context
The WSS tool reports observations from the selected test context. Record the endpoint, region, time, transport, and sample definition before comparing results.
Open the WSS measurement tool