Amazon's marketplace has seen a surge in the availability of books aimed at individuals managing ADHD, many of which are reportedly authored by artificial intelligence, such as ChatGPT. These publications often promise expert advice but have raised concerns among experts regarding their reliability and safety.
Titles including Navigating ADHD in Men: Thriving with a Late Diagnosis and Men with Adult ADHD: Highly Effective Techniques for Mastering Focus, Time Management and Overcoming Anxiety have surfaced in this growing category. A review by Originality.ai, a US-based content detection company, established that eight books sampled received a 100% score on AI detection, indicating strong confidence that they were generated by automated systems.
Experts express alarm at the proliferation of these AI-generated texts, describing online marketplaces as a “wild west” characterised by a lack of regulatory oversight. This environment poses a risk that misinformation, particularly on health issues, could proliferate unchecked. Michael Cook, a computer science researcher at King’s College London, articulated the concern that generative AI may dispense dangerous advice, potentially leading to misdiagnoses or exacerbated health conditions. He pointed out that while these systems are trained on a variety of medical literature, they are equally influenced by misinformation, pseudoscience and fictional narratives.
Cook emphasised the limitations of generative AI in critical task performance, stating, “Generative AI systems like ChatGPT may have been trained on a lot of medical textbooks and articles, but they’ve also been trained on pseudoscience, conspiracy theories and fiction.” He advocates for expert oversight when AI systems deal with sensitive health topics, highlighting a significant gap in accountability for both AI content creators and platforms like Amazon.
Prof. Shannon Vallor, director of the University of Edinburgh’s Centre for Technomoral Futures, echoed these sentiments, noting that Amazon bears some ethical responsibility in preventing harm through the materials it sells. She elaborated on the transformed landscape of publishing, where traditional safeguards such as author vetting have been diminished by AI proliferation.
Critically, there is currently no legislation mandating that AI-generated books be labelled as such, which complicates attribution and accountability. Though the Advertising Standards Agency has guidelines preventing misleading claims about authorship, enforcement remains challenging.
Richard Wordsworth, a recent ADHD diagnosis recipient, expressed disappointment and concern after purchasing a book on Amazon that claimed to offer insights into his condition. Upon reading, he found the text peculiar and untrustworthy, containing dubious advice and attributing emotional damage to ADHD behaviors without adequate warnings. Wordsworth recounted how his initial reliance on the book's authority shifted to distress as he uncovered the lack of credentials of its purported author. He reflected on the alarming possibility that well-intended individuals could be directed towards misleading or harmful information without sufficient scrutiny.
In response to these concerns, an Amazon spokesperson stated, “We have content guidelines governing which books can be listed for sale and we have proactive and reactive methods that help us detect content that violates our guidelines, whether AI-generated or not.” The spokesperson also assured that the company is continuously enhancing its protection measures against non-compliant content.
As the conversation about the implications of AI-generated literature continues, the intersection of technology, publishing, and consumer safety remains a point of considerable scrutiny. The dynamics of this landscape may necessitate a re-evaluation of existing regulations to ensure that vulnerable consumers are safeguarded from potentially harmful information.
Source: Noah Wire Services