Detecting Synthetic Text Profiles: Human Discernment Versus AI Analytics
Regina M. Luttrell, Jason Davis, Carrie Welch · Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences · 2026
This study evaluated human vulnerability to synthetic text profiles generated by artificial intelligence. As large language models become more sophisticated, distinguishing between human and AI-generated content grows increasingly difficult. Our findings show that humans consistently struggled to detect synthetic profiles, which highlights the importance of developing AI tools not only for detection but also for supporting human discernment. By establishing a benchmark of current human capabilities, this research offers a snapshot in time - a necessary step toward tracking how human judgment evolves alongside advancing AI systems through a direct comparison of human performance vs analytic detection approaches. Without such records, it becomes difficult to support users in keeping pace with synthetic media and maintaining control over how credibility is evaluated in digital environments.