There is a reason generative AI has proven inherently well-suited to coding. Writing software is a language-driven task, but one that is highly structured and rule-based, and there are massive pre-existing repositories of viable code for the models to draw on.