Calibration

Methodology

Forecasts in the IC Brief use Words of Estimative Probability (WEP), the standard probability language of the US Intelligence Community. Each forecast carries a time window. When the window closes, the outcome is scored against the stated probability using a Brier score (0 is perfect, 0.25 is a coin flip).

From 2 September 2026 the resolver was told that an event that happened before a forecast was published does not count; from 5 November 2026 such a claim is marked superseded and left out of the score. Verdicts recorded before those dates stand.

Brier score, all forecasts to date

0.10 0.15 0.20 0.25 0.30 2026-04-23 2026-06-14 2026-08-05 2026-09-28 2026-11-19 Brier 0.195 (n=78), published to 2026-04-23 Brier 0.173 (n=141), published to 2026-04-24 Brier 0.172 (n=225), published to 2026-04-25 Brier 0.169 (n=247), published to 2026-04-26 Brier 0.165 (n=263), published to 2026-04-27 Brier 0.166 (n=316), published to 2026-04-28 Brier 0.168 (n=363), published to 2026-04-29 Brier 0.171 (n=414), published to 2026-04-30 Brier 0.174 (n=477), published to 2026-05-01 Brier 0.170 (n=538), published to 2026-05-02 Brier 0.167 (n=603), published to 2026-05-03 Brier 0.170 (n=675), published to 2026-05-04 Brier 0.172 (n=754), published to 2026-05-05 Brier 0.172 (n=811), published to 2026-05-06 Brier 0.174 (n=871), published to 2026-05-07 Brier 0.175 (n=918), published to 2026-05-08 Brier 0.173 (n=978), published to 2026-05-09 Brier 0.172 (n=1,058), published to 2026-05-10 Brier 0.175 (n=1,131), published to 2026-05-11 Brier 0.176 (n=1,173), published to 2026-05-12 Brier 0.177 (n=1,225), published to 2026-05-13 Brier 0.179 (n=1,276), published to 2026-05-14 Brier 0.181 (n=1,335), published to 2026-05-15 Brier 0.181 (n=1,370), published to 2026-05-16 Brier 0.182 (n=1,413), published to 2026-05-17 Brier 0.182 (n=1,453), published to 2026-05-18 Brier 0.182 (n=1,493), published to 2026-05-19 Brier 0.182 (n=1,527), published to 2026-05-20 Brier 0.184 (n=1,558), published to 2026-05-21 Brier 0.185 (n=1,577), published to 2026-05-22 Brier 0.186 (n=1,617), published to 2026-05-23 Brier 0.187 (n=1,663), published to 2026-05-24 Brier 0.187 (n=1,706), published to 2026-05-25 Brier 0.186 (n=1,749), published to 2026-05-26 Brier 0.186 (n=1,781), published to 2026-05-27 Brier 0.186 (n=1,809), published to 2026-05-28 Brier 0.185 (n=1,852), published to 2026-05-29 Brier 0.185 (n=1,901), published to 2026-05-30 Brier 0.185 (n=1,937), published to 2026-05-31 Brier 0.186 (n=1,974), published to 2026-06-01 Brier 0.185 (n=2,010), published to 2026-06-02 Brier 0.185 (n=2,051), published to 2026-06-03 Brier 0.186 (n=2,081), published to 2026-06-04 Brier 0.187 (n=2,126), published to 2026-06-05 Brier 0.188 (n=2,173), published to 2026-06-06 Brier 0.189 (n=2,222), published to 2026-06-07 Brier 0.188 (n=2,265), published to 2026-06-08 Brier 0.188 (n=2,299), published to 2026-06-09 Brier 0.188 (n=2,342), published to 2026-06-10 Brier 0.188 (n=2,381), published to 2026-06-11 Brier 0.189 (n=2,412), published to 2026-06-12 Brier 0.189 (n=2,460), published to 2026-06-13 Brier 0.188 (n=2,534), published to 2026-06-14 Brier 0.188 (n=2,619), published to 2026-06-15 Brier 0.188 (n=2,710), published to 2026-06-16 Brier 0.188 (n=2,785), published to 2026-06-17 Brier 0.187 (n=2,874), published to 2026-06-18 Brier 0.188 (n=2,940), published to 2026-06-19 Brier 0.188 (n=3,022), published to 2026-06-20 Brier 0.187 (n=3,101), published to 2026-06-21 Brier 0.188 (n=3,180), published to 2026-06-22 Brier 0.189 (n=3,257), published to 2026-06-23 Brier 0.188 (n=3,330), published to 2026-06-24 Brier 0.189 (n=3,413), published to 2026-06-25 Brier 0.189 (n=3,502), published to 2026-06-26 Brier 0.188 (n=3,578), published to 2026-06-27 Brier 0.189 (n=3,662), published to 2026-06-28 Brier 0.189 (n=3,747), published to 2026-06-29 Brier 0.189 (n=3,804), published to 2026-06-30 Brier 0.188 (n=3,860), published to 2026-07-01 Brier 0.188 (n=3,931), published to 2026-07-02 Brier 0.187 (n=4,003), published to 2026-07-03 Brier 0.187 (n=4,069), published to 2026-07-04 Brier 0.187 (n=4,150), published to 2026-07-05 Brier 0.186 (n=4,232), published to 2026-07-06 Brier 0.186 (n=4,307), published to 2026-07-07 Brier 0.185 (n=4,382), published to 2026-07-08 Brier 0.185 (n=4,447), published to 2026-07-09 Brier 0.185 (n=4,520), published to 2026-07-10 Brier 0.184 (n=4,599), published to 2026-07-11 Brier 0.184 (n=4,664), published to 2026-07-12 Brier 0.183 (n=4,745), published to 2026-07-13 Brier 0.183 (n=4,827), published to 2026-07-14 Brier 0.182 (n=4,915), published to 2026-07-15 Brier 0.182 (n=4,982), published to 2026-07-16 Brier 0.182 (n=5,046), published to 2026-07-17 Brier 0.181 (n=5,114), published to 2026-07-18 Brier 0.181 (n=5,176), published to 2026-07-19 Brier 0.181 (n=5,259), published to 2026-07-20 Brier 0.181 (n=5,322), published to 2026-07-21 Brier 0.182 (n=5,382), published to 2026-07-22 Brier 0.182 (n=5,444), published to 2026-07-23 Brier 0.182 (n=5,500), published to 2026-07-24 Brier 0.182 (n=5,538), published to 2026-07-25 Brier 0.182 (n=5,619), published to 2026-07-26 Brier 0.181 (n=5,693), published to 2026-07-27 Brier 0.181 (n=5,752), published to 2026-07-28 Brier 0.181 (n=5,833), published to 2026-07-29 Brier 0.181 (n=5,909), published to 2026-07-30 Brier 0.181 (n=5,978), published to 2026-07-31 Brier 0.180 (n=6,043), published to 2026-08-01 Brier 0.181 (n=6,104), published to 2026-08-02 Brier 0.180 (n=6,186), published to 2026-08-03 Brier 0.180 (n=6,231), published to 2026-08-04 Brier 0.180 (n=6,266), published to 2026-08-05 Brier 0.180 (n=6,296), published to 2026-08-06 Brier 0.180 (n=6,337), published to 2026-08-07 Brier 0.180 (n=6,387), published to 2026-08-08 Brier 0.180 (n=6,422), published to 2026-08-09 Brier 0.180 (n=6,456), published to 2026-08-10 Brier 0.180 (n=6,499), published to 2026-08-11 Brier 0.180 (n=6,532), published to 2026-08-12 Brier 0.180 (n=6,571), published to 2026-08-13 Brier 0.180 (n=6,604), published to 2026-08-14 Brier 0.180 (n=6,648), published to 2026-08-15 Brier 0.179 (n=6,685), published to 2026-08-16 Brier 0.179 (n=6,723), published to 2026-08-17 Brier 0.179 (n=6,767), published to 2026-08-18 Brier 0.179 (n=6,811), published to 2026-08-19 Brier 0.179 (n=6,856), published to 2026-08-20 Brier 0.178 (n=6,885), published to 2026-08-21 Brier 0.178 (n=6,922), published to 2026-08-22 Brier 0.178 (n=6,958), published to 2026-08-23 Brier 0.178 (n=6,994), published to 2026-08-24 Brier 0.178 (n=7,021), published to 2026-08-25 Brier 0.178 (n=7,059), published to 2026-08-26 Brier 0.177 (n=7,085), published to 2026-08-27 Brier 0.177 (n=7,119), published to 2026-08-28 Brier 0.177 (n=7,163), published to 2026-08-30 Brier 0.177 (n=7,192), published to 2026-08-31 Brier 0.177 (n=7,230), published to 2026-09-01 Brier 0.177 (n=7,255), published to 2026-09-02 Brier 0.177 (n=7,308), published to 2026-09-03 Brier 0.177 (n=7,356), published to 2026-09-04 Brier 0.177 (n=7,399), published to 2026-09-05 Brier 0.177 (n=7,437), published to 2026-09-06 Brier 0.178 (n=7,475), published to 2026-09-07 Brier 0.178 (n=7,511), published to 2026-09-08 Brier 0.178 (n=7,540), published to 2026-09-09 Brier 0.177 (n=7,570), published to 2026-09-10 Brier 0.177 (n=7,602), published to 2026-09-11 Brier 0.177 (n=7,653), published to 2026-09-12 Brier 0.177 (n=7,698), published to 2026-09-13 Brier 0.177 (n=7,739), published to 2026-09-14 Brier 0.177 (n=7,797), published to 2026-09-15 Brier 0.177 (n=7,832), published to 2026-09-16 Brier 0.177 (n=7,869), published to 2026-09-17 Brier 0.177 (n=7,899), published to 2026-09-18 Brier 0.177 (n=7,939), published to 2026-09-19 Brier 0.177 (n=7,981), published to 2026-09-20 Brier 0.177 (n=8,020), published to 2026-09-21 Brier 0.177 (n=8,060), published to 2026-09-22 Brier 0.177 (n=8,099), published to 2026-09-23 Brier 0.177 (n=8,128), published to 2026-09-24 Brier 0.177 (n=8,162), published to 2026-09-25 Brier 0.176 (n=8,191), published to 2026-09-26 Brier 0.176 (n=8,215), published to 2026-09-27 Brier 0.176 (n=8,259), published to 2026-09-28 Brier 0.176 (n=8,304), published to 2026-09-29 Brier 0.176 (n=8,333), published to 2026-09-30 Brier 0.176 (n=8,369), published to 2026-10-01 Brier 0.176 (n=8,395), published to 2026-10-02 Brier 0.176 (n=8,416), published to 2026-10-03 Brier 0.176 (n=8,459), published to 2026-10-04 Brier 0.176 (n=8,491), published to 2026-10-05 Brier 0.176 (n=8,526), published to 2026-10-06 Brier 0.176 (n=8,552), published to 2026-10-07 Brier 0.176 (n=8,590), published to 2026-10-08 Brier 0.176 (n=8,617), published to 2026-10-09 Brier 0.176 (n=8,652), published to 2026-10-10 Brier 0.176 (n=8,685), published to 2026-10-11 Brier 0.176 (n=8,714), published to 2026-10-12 Brier 0.176 (n=8,752), published to 2026-10-13 Brier 0.176 (n=8,780), published to 2026-10-14 Brier 0.176 (n=8,806), published to 2026-10-15 Brier 0.176 (n=8,836), published to 2026-10-16 Brier 0.176 (n=8,869), published to 2026-10-17 Brier 0.176 (n=8,899), published to 2026-10-18 Brier 0.176 (n=8,926), published to 2026-10-19 Brier 0.176 (n=8,954), published to 2026-10-20 Brier 0.176 (n=8,988), published to 2026-10-21 Brier 0.176 (n=9,014), published to 2026-10-22 Brier 0.176 (n=9,037), published to 2026-10-23 Brier 0.176 (n=9,066), published to 2026-10-24 Brier 0.176 (n=9,086), published to 2026-10-25 Brier 0.176 (n=9,108), published to 2026-10-26 Brier 0.176 (n=9,127), published to 2026-10-27 Brier 0.176 (n=9,145), published to 2026-10-28 Brier 0.176 (n=9,164), published to 2026-10-29 Brier 0.176 (n=9,194), published to 2026-10-30 Brier 0.176 (n=9,217), published to 2026-10-31 Brier 0.176 (n=9,249), published to 2026-11-01 Brier 0.176 (n=9,273), published to 2026-11-02 Brier 0.175 (n=9,297), published to 2026-11-03 Brier 0.175 (n=9,326), published to 2026-11-04 Brier 0.175 (n=9,349), published to 2026-11-05 Brier 0.175 (n=9,367), published to 2026-11-06 Brier 0.175 (n=9,386), published to 2026-11-07 Brier 0.175 (n=9,408), published to 2026-11-08 Brier 0.175 (n=9,425), published to 2026-11-09 Brier 0.175 (n=9,441), published to 2026-11-10 Brier 0.175 (n=9,454), published to 2026-11-11 Brier 0.175 (n=9,472), published to 2026-11-12 Brier 0.175 (n=9,490), published to 2026-11-13 Brier 0.175 (n=9,506), published to 2026-11-14 Brier 0.175 (n=9,512), published to 2026-11-15 Brier 0.175 (n=9,523), published to 2026-11-16 Brier 0.175 (n=9,538), published to 2026-11-17 Brier 0.174 (n=9,553), published to 2026-11-18 Brier 0.174 (n=9,554), published to 2026-11-19 0.174 0.25 coin-flip Publish date (left = oldest) Brier score (lower is better)

Brier score by month published

0.00 0.05 0.10 0.15 0.20 0.25 0.30 Apr 2026: Brier 0.171, 414 scored 0.171 414 scored Apr 2026 May 2026: Brier 0.189, 1,523 scored 0.189 1,523 scored May 2026 Jun 2026: Brier 0.192, 1,867 scored 0.192 1,867 scored Jun 2026 Jul 2026: Brier 0.167, 2,174 scored 0.167 2,174 scored Jul 2026 Aug 2026: Brier 0.158, 1,214 scored 0.158 1,214 scored Aug 2026 Sep 2026: Brier 0.171, 1,141 scored 0.171 1,141 scored Sep 2026 Oct 2026: Brier 0.173, 884 scored 0.173 884 scored Oct 2026 Nov 2026: Brier 0.134, 337 scored 0.134 337 scored Nov 2026 0.25 coin-flip Month published Brier score (lower is better)

Reliability curve

0.00 0.00 0.25 0.25 0.50 0.50 0.75 0.75 1.00 1.00 Expected probability (WEP band midpoint) Empirical hit rate almost no chance: 2/25 = 8.0% (expected 5%) n=25 very unlikely: 100/1007 = 9.9% (expected 15%) n=1007 unlikely: 610/2567 = 23.8% (expected 30%) n=2567 genuinely uncertain: 426/784 = 54.3% (expected 50%) n=784 likely: 2608/3695 = 70.6% (expected 70%) n=3695 very likely: 1276/1414 = 90.2% (expected 85%) n=1414 almost certainly: 57/62 = 91.9% (expected 95%) n=62

Worst calls (rolling 30 days)

The forecasts we got most wrong in the last 30 days, ranked by squared error: how far the probability we stated sat from what happened. A call lands here when we said a claim was very likely and it proved false, or very unlikely and it proved true. Outcome records whether the claim proved true, not whether the call was right.

ProductOutcomeSq. Error
PDBNO0.722
Predicted: very likely: Neither the United States nor the European Union will impose new targeted sanctions or issue a joint formal condemnation specifically addressing South Sudan's government dissolution decree or Russia's documented Duma election fraud within 30 days of September 23, 2026.
How it resolved: Forecast: very likely (85%). The claim proved false. The EU imposed new targeted sanctions specifically addressing Russia's Duma elections within the forecast window, contradicting the predicted non-action. On September 28, 2026, the EU Council sanctioned 10 Russian officials (judges, prosecutors) for their roles in barring the Yabloko opposition party from the Duma elections and jailing its leaders (Pravda.com.ua, Jurist.org).
ICBRIEFNO0.722
Predicted: very likely: The classified Patel Report's contents, or an unclassified summary of it, are publicly reported by at least one major news outlet by 2026-10-25.
How it resolved: Forecast: very likely (85%). The claim proved false. The contents of the classified Patel Report were not publicly reported by any major news outlet by October 25, 2026. Multiple searches across different queries and time frames show that while the report's existence and distribution to FBI employees were widely covered (AP, Washington Post, PBS, Federal News Network, etc.) starting October 2, 2026, no outlet published the report's actual contents or an unclassified summary.
UKRAINENO0.722
Predicted: very likely: Ukraine will strike at least one Russian defense-industrial facility producing air-defense, radar, or electronic-warfare components beyond 500 km from the Ukrainian border within 30 days of September 25, 2026.
How it resolved: Forecast: very likely (85%). The claim proved false. No strike during the September 25–October 25, 2026 window hit a defense-industrial facility producing air-defense, radar, or EW components beyond 500 km from Ukraine's border. Ukraine's Ministry of Defence October 2026 deep-strike summary (mod.gov.ua) exhaustively lists all seven defense-industry targets struck: Proton-Electrotex (~170 km), Kamensky (~200 km), Energiya (~280 km), Roboavia (~180 km), Redkino (~500 km), and TsENKI/ICBM centers (~650 km).
PDBNO0.722
Predicted: very likely: Japan's Joint Staff Office reports the Liaoning carrier strike group operating in the Pacific east of the first island chain beyond the current Philippine Sea position, or conducting flight operations after Keen Sword 27 begins, by October 25, 2026.
How it resolved: Forecast: very likely (85%). The claim proved false. The Liaoning carrier strike group did not operate further east in the Pacific beyond its Philippine Sea position, nor were flight operations reported after Keen Sword 27 began on October 19. Japan's Joint Staff Office report dated October 19 confirmed that on October 15, the four PLAN vessels (Liaoning and three destroyers) were sailing toward the South China Sea, the opposite direction from further east into the Pacific.
PDBNO0.722
Predicted: very likely: María Corina Machado will remain unable to return to Venezuela within the next 30 days (by October 26, 2026).
How it resolved: Forecast: very likely (85%). The claim proved false. María Corina Machado returned to Venezuela on October 25, 2026, one day before the forecast window closed on October 26, contradicting the claim that she would remain unable to return. Multiple authoritative outlets, including Al Jazeera, NPR, The Washington Post, and CNN, reported her unannounced return after roughly ten months in exile, entering from Colombia.
ICBRIEFNO0.722
Predicted: very likely: Israeli security services will publicly attribute at least one specific Iranian influence or cyber operation targeting the October 2026 Israeli election beyond the existing Shin Bet classified briefing warning by October 27, 2026.
How it resolved: Forecast: very likely (85%). The claim proved false. Israeli security services did not publicly attribute a specific Iranian influence or cyber operation targeting the October 2026 election within the forecast window. Shin Bet's October 22 public announcement about removing foreign influence accounts explicitly declined to name Iran or any country of origin, as confirmed by Ynet, Israel National News, Haaretz, and the INSS report (which stated it was 'impossible to attribute them to a specific foreign actor' based on available public information).
PDBNO0.722
Predicted: very likely: Certified or official results show the Alberta option to remain in Canada winning a majority on the main separation question, announced by October 27, 2026.
How it resolved: Forecast: very likely (85%). The claim proved false. Official or certified results were not announced by October 27, 2026; Elections Alberta scheduled their release for October 29, 2026 at 10 a.m., two days after the forecast window closed. Multiple sources, including Daily Hive, Wikipedia's 2026 Alberta independence referendum article, and Ground News, confirm that only unofficial results were available on election night (October 19) and in the days following, showing remain winning Question 10 with approximately 74.9–76% of the vote.
UKRAINENO0.722
Predicted: very likely: Russia and Ukraine reach no formal ceasefire, partial truce, or binding Black Sea shipping agreement that enters into force before October 31, 2026.
How it resolved: Forecast: very likely (85%). The claim proved false. A localized but formally agreed ceasefire in Oleshky entered into force before October 31, 2026, contradicting the claim that no formal ceasefire or partial truce would materialize. Both Russia's General Staff (announcing an October 27 start) and Ukraine's General Staff confirmed the halt, brokered through U.S. First Lady Melania Trump, to allow humanitarian aid delivery and civilian evacuation, as reported by The Moscow Times (Oct 24), the White House (Oct 29), and Vatican News.
UKRAINENO0.722
Predicted: very likely: The Verkhovna Rada will vote to dismiss Prosecutor General Kravchenko before completing a first reading of any of the seven draft laws Zelensky linked to closing Ukraine's $27 billion defense budget gap.
How it resolved: Forecast: very likely (85%). The claim proved false. The Verkhovna Rada voted to dismiss Prosecutor General Kravchenko on September 15, 2026, one day before the forecast was published on September 16, 2026, at 00:18 UTC; per the scoring rules, an event that happened before publication does not count. Multiple outlets (Ukrainska Pravda, Interfax-Ukraine, UNN) confirm the 317-vote dismissal on September 15.
PDBNO0.722
Predicted: very likely: The Riksdag confirms Magdalena Andersson as Prime Minister of a new center-left government by 2026-10-31.
How it resolved: Forecast: very likely (85%). The claim proved false. Magdalena Andersson was not confirmed as Prime Minister by October 31, 2026. On 15 October 2026, the Riksdag rejected her nomination with 99 votes in favor and 248 against, as reported on the Riksdag's official website and the Wikipedia article on the 2026 Swedish government formation.