Will an Anthropic Claude model score at least 45% on Humanity’s Last Exam?

No / 56.0¢

+10.00

$5.6

Yes / 44.0¢

+10.00

$4.5

Yes / 43.0¢

-16.85

$7.25

Yes / 43.0¢

+16.85

$7.41

Yes / 43.0¢

-35.00

$15.1

No / 56.0¢

-35.00

$19.6

Yes / 43.0¢

-43.35

$18.6

Yes / 43.0¢

+43.35

$19.1

No / 57.0¢

+16.28

$9.28

Yes / 43.0¢

+16.28

$7.16

No / 57.0¢

+248.00

$144

No / 57.0¢

-239.00

$136

No / 57.0¢

-9.00

$5.13

No / 58.0¢

-5.00

$2.9

No / 58.0¢

+5.00

$2.95

Yes / 43.3¢

+231.19

$102

No / 57.0¢

+37.00

$21.1

No / 57.0¢

+37.00

$21.1

Yes / 44.0¢

-68.94

$30.3

No / 57.0¢

+37.00

$21.1

No / 59.0¢

+5.00

$2.95

No / 57.0¢

+9.25

$5.27

No / 57.0¢

+37.00

$21.1

No / 58.0¢

+9.00

$5.22

No / 59.0¢

+10.00

$5.9