People get really excited when a model writes a working program when the only times I've seen that work is when it is so bog standard that it is no different than copy-pasting from a GitHub repo.

Given the average number of edge cases in even the most standard web app, things go off the rails pretty fast.