Several big businesses have published source code that incorporates a software package previously hallucinated by generative AI.
Not only that but someone, having spotted this reoccurring hallucination, had turned that made-up dependency into a real one, which was subsequently downloaded and installed thousands of times by developers as a result of the AI's bad advice, we've learned. If the package was laced with actual malware, rather than being a benign test, the results could have been disastrous.
Ended up in code on Alibaba.
https://www.theregister.com/2024/03/28/ai_bots_hallucinate_software_packages/via
https://pluralistic.net/2024/04/01/human-in-the-loop/