A Visual Turing Test for Authorship Attribution

Visual Cues, Confidence, and Accuracy in Identifying AI-Generated Images among Visual Arts Professionals

Authors

DOI:

https://doi.org/10.62161/revvisual.v18.6439

Keywords:

Generative AI, Visual Turing Test, Image, Autorship, Attribution, Metacognition

Abstract

This study adapts a Visual Turing Test to examine authorship attribution (human vs generative AI) among visual arts professionals (N=28) using 10 balanced stimuli. For each image, participants reported an authorship decision, confidence (1–5), weights for five cue families, and aesthetic quality before and after authorship disclosure. Overall accuracy was moderate (57.1%), with false positives for highly polished human images and false negatives for abstract or linear styles. Confidence was poorly calibrated and predicted lower accuracy; structure/space and lighting/color predicted higher accuracy. Disclosure tended to reduce ratings more for AI images.

Downloads

Download data is not yet available.

Global Statistics ℹ️

Cumulative totals since publication
4
Views
0
Downloads
4
Total
Downloads by format:
PDF (Español (España)) 0 PDF 0

References

Akhtar, Z. (2023). Deepfakes generation and detection: A short survey. Journal of Imaging, 9(1), 18. 10.3390/jimaging9010018

Bellaiche, L., Shahi, R., Turpin, M. H., Ragnhildstveit, A., Sprockett, S., Barr, N., Christensen, A. & Seli, P. (2023). Humans versus AI: Whether and why we prefer human-created compared to AI-created artwork. Cognitive Research, 8, 42. 10.1186/s41235-023-00499-6

Bray, S. D., Johnson, S. D. & Kleinberg, B. (2023). Testing human ability to detect “deepfake” images of human faces. Journal of Cybersecurity, 9(1), tyad011. 10.1093/cybsec/tyad011

Carceller, A. (2024). The ARTificial Revolution: Challenges for Redefining Art Education in the Paradigm of Generative Artificial Intelligence. Digital Education Review, 45, 84-90. 10.1344/der.2024.45.84-90

Cenerini, C., Keller, F., Pennazza, G., Scantonico, M. & Vollero, L. (2025). Artistic Turing test: The challenge of differentiating human and AI-generated art. Computers in Human Behavior: Artificial Humans, 6. 10.1016/j.chbah.2025.100209

Chiarella, S. G., Torromino, G., Gagliardi, D. M., Rossi, D., Babiloni, F. & Cartocci, G. (2022). Investigating the negative bias toward artificial intelligence: The effects of prior assignment of AI authorship on the aesthetic appreciation of abstract paintings. Computers in Human Behavior, 137. 10.1016/j.chb.2022.107406

Demmer, T. R., Kühnapfel, C., Fingerhut, J. & Pelowski, M. (2023). Does an emotional connection to art really require a human artist? Emotion and intentionality responses to AI- versus human-created art and impact on aesthetic experience. Computers in Human Behavior, 148. 10.1016/j.chb.2023.107875

Dunlosky, J. & Metcalfe, J. (2009). Metacognition. Sage.

European Parliament y Council of the European Union. (2016). Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data (General Data Protection Regulation). Official Journal of the European Union, L119, 1–88.

Fleming, S. M. & Lau, H. (2014). How to measure metacognition. Frontiers in Human Neuroscience, 8, 443. 10.3389/fnhum.2014.00443

Gangadharbatla, H. (2022). The role of AI attribution knowledge in the evaluation of artwork. Empirical Studies of the Arts, 40(1), 55–74. 10.1177/0276237421994697

Geman, D., Geman, S., Hallonquist, N. & Younes, L. (2015). Visual Turing test for computer vision systems. Proceedings of the National Academy of Sciences, 112(12), 3618–3623. 10.1073/pnas.1422953112

Horton Jr, C. B., White, M. W. & Iyengar, S. S. (2023). Bias against AI art can enhance perceptions of human creativity. Scientific Reports, 13, 19001. 10.1038/s41598-023-45202-3

Hulzebosch, N., Ibrahimi, S. & Worring, M. (2020). Detecting CNN-generated facial images in real-world scenarios. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 642–643. 10.1109/CVPRW50498.2020.00329

Korshunov, P & Marcel, S. (2018). DeepFakes: A new threat to face recognition? Assessment and detection. 10.48550/arXiv.1812.08685

Imanpour, N., Borah, A., Bajpai, S., Ghosh, S., Sankepally, S. R., Abdullah, H. M., Kosaraju, N., Dixit, S., Aziz, A., Biswas, S., Jain, V., Chadha, A., Wang, S., Sheth, A. & Das, A. (2025). The Visual Counter Turing Test (VCT²): A benchmark for evaluating AI-generated image detection and the Visual AI Index (V_AI). En Proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics, 1847–1862. The Asian Federation of Natural Language Processing y Association for Computational Linguistics.

https://aclanthology.org/2025.ijcnlp-long.100/

Kirk, U., Skov, M., Hulme, O., Christensen, M. S. & Zeki, S. (2009). Modulation of aesthetic value by semantic context: An fMRI study. NeuroImage, 44(3), 1125–1132.

10.1016/j.neuroimage.2008.10.009

Koriat, A. (2012). The relationships between monitoring, regulation and performance. Learning and Instruction, 22(4), 296–298. 10.1016/j.learninstruc.2012.01.002

Korus, P. (2017). Digital image integrity–a survey of protection and verification techniques. Digital Signal Processing, 71, 1-26 10.1016/j.dsp.2017.08.009Get rights and content

Lago, F., Pasquini, C., Böhme, R., Dumont, H., Goffaux, V. & Boato, G. (2021). More real than real: A study on human visual perception of synthetic faces. 10.48550/arXiv.2106.07226

Leder, H. & Nadal, M. (2014). Ten years of a model of aesthetic appreciation and aesthetic judgments: The aesthetic episode—Developments and challenges in empirical aesthetics. British Journal of Psychology, 105(4). 10.1111/bjop.12084

Lu, Z., Di Huang, Lei Bai, Jingjing Qu, Chengyue Wu, Xihui Liu & Wanli Ouyang (2023). Seeing is not always believing: Benchmarking human and model perception of AI-generated images. 10.48550/arXiv.2304.13023

Millet, K., Buehler, F., Du, G & Kokkoris, M. D. (2023). Defending humankind: Anthropocentric bias in the appreciation of AI art. Computers in Human Behavior, 143, 107707. 10.1016/j.chb.2023.107707

Nightingale, S. J. & Farid, H. (2022). AI-synthesized faces are indistinguishable from real faces and more trustworthy. Proceedings of the National Academy of Sciences, 119(8), e2120481119. 10.1073/pnas.2120481119

Ragot, M., Martin, N. & Cojean, S. (2020). AI-generated vs. human artworks: A perception bias towards artificial intelligence. En Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. 10.1145/3334480.3382892

Ritchin, F. (2013). Bending the frame: Photojournalism, documentary, and the citizen. Aperture.

Shin, K., Lee, J. S., Lee, J. Y., Lee, H., Kim, J., Byeon, J.-S., Jung, H.-Y., Kim, D. H. & Kim, N. (2023). An image Turing test on realistic gastroscopy images generated by using the progressive growing of generative adversarial networks. Journal of Digital Imaging, 36, 1760–1769. 10.1007/s10278-023-00803-2

Tang, N., Gong, S., Zhou, J., Shen, M., & Gao, T. (2023). Generative visual common sense: Testing analysis-by-synthesis on Mondrian-style image. Journal of experimental psychology. General, 152(10), 2713–2734. 10.1037/xge0001413

Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A. & Ortega-Garcia, J. (2020). DeepFakes and beyond: A survey of face manipulation and fake detection. Information Fusion, 64, 131–148. 10.1016/j.inffus.2020.06.014

Torres, A. (2025). A cartography of ambivalence: The sublime and the uncanny in the generative artificial intelligence iconosphere. Rita, (24), 65–78.

Verdoliva, L. (2020). Media forensics and deepfakes: An overview. IEEE Journal of Selected Topics in Signal Processing, 14(5), 910–932. 10.1109/JSTSP.2020.3002101

Wang, C. (2024). Human or algorithm? The visual Turing test of AI-generated images. Journal of Multimedia Information System, 11(3), 201–212. 10.33851/JMIS.2024.11.3.201

Published

2026-11-19

How to Cite

Torres-Carceller, A., & Castell-Villanueva, J. (2026). A Visual Turing Test for Authorship Attribution: Visual Cues, Confidence, and Accuracy in Identifying AI-Generated Images among Visual Arts Professionals . VISUAL REVIEW. International Visual Culture Review Revista Internacional De Cultura Visual, 18(6), 15–30. https://doi.org/10.62161/revvisual.v18.6439