Will an Anthropic Claude model score at least 55% on Humanity’s Last Exam?

No / 93.1¢

-3.22

$3

No / 93.1¢

+3.22

$3.01

Yes / 12.5¢

+40.01

$5.17

Yes / 12.5¢

-39.22

$4.9

No / 87.6¢

+0.79

$0.69

Yes / 12.4¢

+8.06

$1.04

No / 87.6¢

+8.06

$7.06

No / 87.6¢

+1.14

$1

No / 87.2¢

-1.14

$0.99

Yes / 12.4¢

-27.30

$3.39

Yes / 12.4¢

+27.30

$3.5

Yes / 12.4¢

+16.13

$2.07

Yes / 12.4¢

-16.13

$2

No / 90.0¢

-50.00

$45

No / 94.2¢

-18.38

$17.3

No / 92.6¢

-79.90

$74

Yes / 11.1¢

+6.50

$0.72

Yes / 8.1¢

+56.00

$4.54

No / 89.2¢

-48.00

$42.8

Yes / 11.0¢

+50.00

$5.5

No / 90.0¢

-100.00

$90

Yes / 5.0¢

+96.67

$4.83

No / 92.0¢

-250.00

$230

No / 89.4¢

-51.86

$46.4

Yes / 8.1¢

-856.38

$69.2