> ~=$3400 per single task report says it is $17 per task, and $6k for whole data...

binarymax · 2024-12-20T19:32:03 1734723123

"Note: OpenAI has requested that we not publish the high-compute costs. The amount of compute was roughly 172x the low-compute configuration."

The low compute was $17 per task. Speculate 172*$17 for the high compute is $2,924 per task, so I am also confused on the $3400 number.

bluecoconut · 2024-12-20T19:33:12 1734723192

3400 came from counting pixels on the plot.

Also its $20 on for the o3-low via the table for the semi-private, which x172 is 3440, also coming in close to the 3400 number

bluecoconut · 2024-12-20T19:19:05 1734722345

That's the low-compute mode. In the plot at the top where they score 88%, O3 High (tuned) is ~3.4k

HDThoreaun · 2024-12-21T01:10:57 1734743457

The low compute one did as well as the average person though

ionwake · 2024-12-20T21:28:35 1734730115

sorry to be a noob, but can someone tell me doe sths mena o3 will be unaffordable for a typical user? Will only companies with thousands to spend per query be able to use this?

Sorry for being thick Im just confused how they can turn this into an addordable service?

JohnnyMarcone · 2024-12-20T23:06:26 1734735986

There are likely many efficiency gains that will be made before it's released, and after. Also they showed o3 mini to be better than o1 for less cost in multiple benchmarks, so there're already improvements there at a lower cost than what available.

ionwake · 2024-12-20T23:30:13 1734737413

Great thank you

xrendan · 2024-12-20T19:35:56 1734723356

You're misreading it, there's two different runs, a low and a high compute run.

The number for the high-compute one is ~172x the first one according to the article so ~=$2900

Thorrez · 2024-12-21T14:16:02 1734790562

What's extra confusing is that in the graph the runs are called low compute and high compute. In the table they're called high efficient and low efficiency. So the high and low got swapped.

jhrmnn · 2024-12-20T19:20:10 1734722410

That’s for the low-compute configuration that doesn’t reach human-level performance (not far though)

riku_iki · 2024-12-20T19:21:04 1734722464

I referred on high compute mode. They have table with breakdown here: https://arcprize.org/blog/oai-o3-pub-breakthrough

junipertea · 2024-12-20T19:30:11 1734723011

The table row with 6k figure refers to high efficiency, not high compute mode. From the blog post:

Note: OpenAI has requested that we not publish the high-compute costs. The amount of compute was roughly 172x the low-compute configuration.

gbnwl · 2024-12-20T19:30:53 1734723053

That's "efficiency" high, which actually means less compute. The 87.5% score using low efficiency (more compute) doesn't have cost listed.

bluecoconut · 2024-12-20T19:31:10 1734723070

they use some poor language.

"High Efficiency" is O3 Low "Low Efficiency" is O3 High

They left the "Low efficiency" (O3 High) values as `-` but you can infer them from the plot at the top.

Note the $20 and $17 per task aligns with the X-axis of the O3-low

EVa5I7bHFq9mnYK · 2024-12-20T19:27:46 1734722866

That's high EFFICIENCY. High efficiency = low compute.