The scary thing is while a construction labourer knows how to properly lay bricks, an AI's output is reliably unreliable. Does the foreman have to go round checking every little thing on the site? That would be a waste of time. Using these AI tools for anything important is too high risk.
There exist many problems for which it's easy to verify the inputs-outputs, but much harder to write the functions to convert the inputs into the outputs.
Just write an executable spec and have the AI generate the code that fulfills it. Where is the risk?
I guess the risk would be that the cost of compute would explode out of control long before you got a viable solution.
To give a bit of an absurd example, I imagine there's a reason it's not currently worth it to generate the code with a random character generator, even though hypothetically that would get you there eventually. If we consider AI a much, MUCH better version of a random character generator (let's say it's a million times faster. No, let's say that it'll get you the solution in quadratic time instead of factorial time), that doesn't necessarily mean it's actually worth it now.
Ok in that case I guess the risk would be that it simply wouldn't work and you'd lose whatever time and compute happened in the time box. Which would be a pretty cheap price to pay, but I imagine you'd only try it a few times before giving up and using a different strategy.
> Does the foreman have to go round checking every little thing on the site?
Uh, is that not half of the foreman’s job? They’re there to direct and coordinate the work, resolve unforeseen issues, and to enforce the required quality of work.
I'm certain they don't check every brick. In the same way I shouldn't have to check simple maths. Today's "AI" can't even reliably add two numbers, it's ridiculous.
