Hacker News new | past | comments | ask | show | jobs | submit login

That might already happen behind what they call test time compute





Many models that use test time compute are MoEs, but test-time compute is generally meant to refer to reasoning about the prompt/problem the model is given, not about reasoning about which model to pick, and I don't think anyone has released an LLM router under that name.

we dont know what OAI does to find the best answer when reasoning but I am pretty sure that having variations of a same model is part of it.



Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: