AI Generated code and the future of development.

Delaney

Potentially relevant:
https://red.anthropic.com/2026/cyber-toolkits-update/

ZenIsFluffy

guser39 Came here to share the Curl project's recent issues as well. Its frustrating that people are looking to make a quick buck. Combine that with how LLMs hallucinate; it has me concerned how Bug Bounty programs can continue to operate. :/

ryrona

monozygote And also, many FOSS maintainers/contibutors might be using coding-agents (but hopefully human-reviewed). They might be reluctant to admit it given the taboo surrounding the mere mention of such a thing - just look at this thread.

Not disclosing AI usage is erring on being unethical behavior, so I hope that is not common. I believe the open source projects that have AI policies today that are permissive towards using AI still require you to disclose if any committed code is AI made.

Let's see what the future holds. The researchers developing frontier AI models seem to believe we have hit a wall. Number of parameters and compute is no longer the limiting factor, but availability of training data is. They have already trained on the whole internet, humanity hasn't produced more online activity, code, papers or books to train on yet. Specialized small local open weight models are catching up, the difference is not that large anymore.

I think the potential for AI coding assistants is huge and very interesting, but I remain skeptical we will reach a level where we can start using them for real anytime soon, unless we see architectural improvements, and they only come about every 5 years or so.

dhhdjbd

I dont know i feel like ai coding tools are aswell partly used to bypass (open source) licenses by companys. If 'the ai did it' instead of just copying x% of an open source project, it is legally suddenly basically impossible to prove it was stolen. I have no prove for this tho, just my opinion.

Functionally i think for coding, ai is fine for stuff that you would previously have done with an example. Like some common pattern / how to use some libary api.
And for debugging (like > instead of < ^^). It might help and save a bit of time.. Generating low quality tests aswell i guess

But this "here is the programm do x" approach, i dont think this is a good practice.

guser39

I do want to add that I am not against AI agents or AI technologies. I am not necessarily against people using GenAI and LLMs. My frustration is more the forced inclusion in so many products and rapid adoption by people vastly unqualified to be using GenAI/LLMs. It is a real world example of the Dunning-Kruger effect. It may be working well for experts or a very select few deg shops but for the majority it is an insidious trap.

Technically speaking, I just don't see how LLMs and GenAI will ever cross the finish line given their probabilistic nature and inability to reason or apply logic. Perhaps this is me being naively hopeful that "minimally viable product" hasn't sunk so low.

I am not sure that I have much of a point here other than that I'll be surprised if GenAI/LLMs actually meet the massively overhyped expectations. I think people should be able to use them but it should be the experts and not forced into everything. More likely, there is going to be a massive bubble that pops.

« Previous Page