The study employed a two-phase experiment involving 200 participants who watched a silent CCTV video of an armed robbery to simulate witnessing a crime12. Participants were then assigned to one of four conditions: a control group, a survey with misleading questions, a pre-scripted chatbot, or a generative chatbot using a large language model32. The experiment assessed false memory formation immediately after the interaction and again one week later3. This methodology allowed researchers to compare the impact of different memory-influencing mechanisms, with the generative chatbot condition emerging as the most potent in inducing false memories12.

The generative chatbot condition in the study induced nearly triple the number of false memories observed in the control group and approximately 1.7 times more than the survey-based method. Notably, 36.8% of responses were misled as false memories one week after the interaction12. These false memories persisted over time, with participants maintaining higher confidence in their inaccurate recollections compared to the control group, even after a week had passed23.

Several factors were identified as influencing an individual's susceptibility to AI-induced false memories. Users who were less familiar with chatbots but more familiar with AI technology in general were found to be more prone to developing false memories.12 Additionally, participants who expressed a higher interest in crime investigations showed increased vulnerability to false memory formation.12 These findings highlight the complex interplay between technological familiarity, personal interests, and cognitive susceptibility in the context of AI-human interactions.

The potential for AI-induced false memories raises significant ethical concerns, particularly in sensitive contexts like legal proceedings and clinical settings. Researchers emphasize the need for careful consideration when deploying advanced AI technologies in areas where memory accuracy is crucial12. The ability of generative chatbots to implant persistent false memories underscores the importance of developing ethical guidelines and legal frameworks to mitigate risks associated with AI use2. As these technologies become increasingly integrated into daily life, addressing the ethical implications of AI's influence on human cognition and memory formation becomes paramount for safeguarding individual and societal interests.