You should be able to provide more data than that in the input if the output doe...

jaredsohn 7 months ago | parent | context | favorite | on: Notes on OpenAI's new o1 chain-of-thought models

You should be able to provide more data than that in the input if the output doesn't use the full 4k tokens. So limit is context_size minus expected length of output.