Forecast calibration board

A public, automatically updated record of what an automated forecasting system predicted and how those predictions scored once the questions resolved. Every score is printed beside the simplest possible baseline - always answering 50% - so a reader can see at once whether the system adds anything. As of 2026-11-04.

Graded forecasts on public markets

Worse than always answering 50% (Brier 0.2776 against 0.2500).

Rows scored69
Brier score (lower is better)0.2776
Baseline: always 50%0.2500
Baseline: the marketnot available - no signed record of the market's price at the moment each forecast was made exists yet, so the market cannot be scored on these rows.

Scored: one forecast per market, the latest, on 69 distinct markets. 86 forecasts are listed below; the 17 earlier re-forecasts of a market already scored are marked * and not counted, so a repeated miss is not counted twice. Markets with no scored forecast (the latest one was refused, undated or tied): 0.

All 69 scored forecasts were graded by a different seat than the one that made the forecast, so the score for independently graded forecasts only is the same as the one above.

Daily market panel: the market's own price at capture

No scored rows yet.

Rows scored0
Brier score (lower is better)-
Baseline: always 50%-
Baseline: the marketnot available

How to read this

Every graded forecast

Forecast dateMarketForecast OutcomeSquared errorRecord
2026-07-31manifold:UP5Qtg5QLU0.30no0.092010959a3d501
2026-08-01manifold:I6sOUp6hUq0.49yes0.26266c99848bac2
2026-08-01manifold:sd8p6yhA0E *0.50yes0.25021cc0521a734
2026-08-01manifold:sd8p6yhA0E *0.53yes0.221f4c6345e92cd
2026-08-01manifold:sd8p6yhA0E0.57yes0.185f3337b55bbc1
2026-08-02manifold:Asc5yyQy05 *0.03yes0.9492e3916426254
2026-08-02manifold:D622e40be5 *0.03yes0.941c1de8df7f648
2026-08-02manifold:qcPC56LOqq0.21no0.0465a67f66e609b
2026-08-03manifold:Asc5yyQy050.03yes0.9459dc81cfc8f3f
2026-08-03manifold:D622e40be50.02yes0.9607ce765ef0fdf
2026-08-03manifold:U8ZZIEdSn50.07yes0.856f4cb6f1bece7
2026-08-05manifold:QzzPnpg9PC0.50yes0.250225ffea08115
2026-08-05manifold:ZRy5uZt68N0.16no0.02609dd112d88f6
2026-08-07manifold:P95npPQNPS0.46no0.2105c10658f1ed8
2026-08-07manifold:cg92PIusZd0.05no0.003eaa1bc287a5e
2026-08-07manifold:gSZc5tdIp60.06no0.0036ceef9fcfc1c
2026-08-08manifold:N5LACuEEnz0.70no0.4872423000e12b2
2026-08-08manifold:RyChAy5t9q *0.03yes0.947bcfbdab7e4aa
2026-08-08manifold:tghq95A6gl0.23yes0.587d483ed57df51
2026-08-09manifold:NAyCpRdt8O0.42no0.175a48df7d2adb0
2026-08-09manifold:RyChAy5t9q0.07yes0.8721549d5552b4e
2026-08-09manifold:dZttUuEPLU0.04no0.001faf6bfd0525e
2026-08-10manifold:8IEdIOCgS00.04no0.00123aef3ac1a8f
2026-08-10manifold:IZOyg6p2zP0.75no0.5621dda5922bc57
2026-08-10manifold:c9PIQPc0SL0.00no0.0005aaa0d066a10
2026-08-11manifold:QNppPpt22q0.11no0.0124607a7b0e8a6
2026-08-11manifold:UhCl6Auc6I0.02no0.000173cd03b01a6
2026-08-12manifold:2cAAR8gcRQ0.02no0.00091f7944777d0
2026-08-12manifold:D31f1624250.53no0.2842fffd54774ad
2026-08-12manifold:R02htZgC6s0.17no0.0295b402c1cc8d1
2026-08-14manifold:ERRUPS69LI0.16no0.027bb93bed413a3
2026-08-14manifold:rBdBsZHwtZ0.25yes0.560daaef0f4ff39
2026-08-14manifold:sRsNCQcRNn0.05no0.0036364e885af41
2026-08-16manifold:6gIu89LplR *0.06no0.0043cac8a81b779
2026-08-16manifold:A5Slcs6NnC0.49no0.244699df68c18bc
2026-08-16manifold:cSIClsAgzp0.06yes0.88714dc0878bab0
2026-08-17manifold:6gIu89LplR0.06no0.003dd1bc13f7563
2026-08-17manifold:Z99pyn2z0n *0.71no0.5075e88d90c5bbd
2026-08-17manifold:ldqqR6qggO0.50no0.250dc080a760364
2026-08-18manifold:Z99pyn2z0n0.67no0.4463f2ed2874617
2026-08-18manifold:g2CstR8guu0.52no0.2680d3394bb89c8
2026-08-18manifold:sRhs9ZuUlh0.52yes0.2307c62678035de
2026-08-19manifold:2qoAknPE50 *0.18yes0.679293101c2807f
2026-08-19manifold:pEy2RL0gIy0.53yes0.2199bd7fb2c5ed1
2026-08-19manifold:zRZzP9lccI *0.39yes0.370550e0942b4b4
2026-08-20manifold:2qoAknPE500.21yes0.621c14c26684469
2026-08-20manifold:AlQRAIc59C0.50yes0.250892aa245ef02
2026-08-20manifold:zRZzP9lccI0.42yes0.3328b15dd703951
2026-10-17manifold:Othp8gA9Pp0.53no0.278efc7cf11d5a9
2026-10-17manifold:nnEInyS6lS0.44no0.1911ffa46642149
2026-10-17manifold:sltO5E5C860.54yes0.2123eb02da13ef3
2026-10-18manifold:0zzLN99ONq *0.08no0.00704891f01a642
2026-10-18manifold:p5Syql8puO0.50yes0.25061f70a340d0a
2026-10-18manifold:tOg96y8LPE0.36yes0.4142aebeb6394bd
2026-10-19manifold:0zzLN99ONq0.07no0.005e4a541fa9a31
2026-10-19manifold:QlpgAupQZ50.39yes0.369324ececb830e
2026-10-19manifold:pc2AtN2A860.04no0.00198ba427de6af
2026-10-21manifold:QP2P0uQyQO0.71no0.4999713f450653a
2026-10-21manifold:dNyUQPNyLd0.53yes0.224abeefd880563
2026-10-21manifold:qqh2LLII9n0.07no0.0057dab8f3a1b08
2026-10-22manifold:5hUsUIn6pL *0.47yes0.28685d264ef6120
2026-10-22manifold:yzAERRREyz0.50yes0.250b523062d0c44
2026-10-23manifold:5hUsUIn6pL0.47yes0.281c3b421e6123d
2026-10-23manifold:EPPNNOz0C80.58no0.3369e365e98a887
2026-10-23manifold:Z9n5SgcU0y *0.09no0.009dda0e1081064
2026-10-24manifold:AhUhASczuu0.50yes0.2507c551cf7a378
2026-10-24manifold:Z9n5SgcU0y0.09no0.008c292461184ed
2026-10-24manifold:ynRLsQZCdy0.07yes0.8652947ed67f75f
2026-10-26manifold:80nz9lU9220.55no0.303af2ed54a00f6
2026-10-26manifold:8p0CPyUclS0.09no0.00844839a719022
2026-10-26manifold:Qy0Lq5QtI90.25yes0.56735f9517b434a
2026-10-27manifold:g9gAld5OZL *0.65yes0.12102855e56c985
2026-10-28manifold:g9gAld5OZL0.61yes0.1548569022b06b5
2026-10-29manifold:PAu99QS2PO *0.02no0.00177e4e95089ba
2026-10-29manifold:RnQ0ROnZgh0.62yes0.14353bc9d2e2b12
2026-10-30manifold:PAu99QS2PO0.02no0.000d40211a254ed
2026-10-30manifold:pspEQg0du90.50yes0.250a2e4ce6ab07a
2026-11-01manifold:8pp8SPhzPl *0.14yes0.7442d144de4acd7
2026-11-01manifold:EI0SggRnRQ *0.04no0.0028dcf70c6bcea
2026-11-01manifold:Z25gnO96tc *0.10no0.011e879f028d6d5
2026-11-02manifold:8pp8SPhzPl0.07yes0.85691a68351377d
2026-11-02manifold:EI0SggRnRQ0.05no0.0023f9d544d0ade
2026-11-02manifold:Z25gnO96tc0.06no0.004be495955f3b0
2026-11-03manifold:RpPqPyZZZA0.11yes0.786c793a6015050
2026-11-03manifold:hZEC8RssuA0.35yes0.423117e3f0df893
2026-11-03manifold:ptugEICOLh0.83yes0.029f4b638052c6f

Daily market panel

Capture dateQuestionMarket price OutcomeSquared errorCapture record
No question has both closed and resolved yet.