Controversial AI-Generated Images Published in Scientific Journal Raise Concerns
In a surprising turn of events, a peer-reviewed science journal recently published a paper filled with nonsensical AI-generated images, causing quite a stir in the academic community. The paper, titled “Cellular functions of spermatogonial stem cells in relation to JAK/STAT signaling pathway,” was published in the open access Frontiers in Cell Development and Biology journal by researchers from Hong Hui Hospital and Jiaotong University in China. While the paper itself may not be of interest to the general public, the images accompanying it have raised eyebrows and sparked concerns about the growing influence of generative AI in academia.
One particularly bizarre image featured in the paper is a diagram of a dissected rat penis. Describing it in words does not do justice to its absurdity. The diagram portrays the rat’s penis as more than double the size of its body, complete with garbled text and labeling errors. Terms like “iollotte sserotgomar cell,” “testtomcels,” and “dck” are clearly products of janky AI generation. However, the AI program did manage to correctly label the organism as a rat. These images were credited to Midjourney, a popular generative AI tool.
Other figures in the paper exhibit similar levels of textual and visual nonsense. Cell diagrams resemble alien pizzas, with labels that are equally perplexing. It is puzzling how these images managed to pass through the editing, peer review, and publishing process without being flagged for their obvious inaccuracies.
Motherboard reached out to the paper’s U.S.-based reviewer, Jingbo Dai of Northwestern University, who claimed that it was not his responsibility to vet the AI-generated images. The second reviewer, based in India, also distanced themselves from the issue. According to Dai, “As a biomedical researcher, I only review the paper based on its scientific aspects. For the AI-generated figures, since the author cited Midjourney, it’s the publisher’s responsibility to make the decision. You should contact Frontiers about their policy of AI-generated figures.”
This incident raises questions about the accountability and oversight in the publishing process, particularly when it comes to AI-generated content. While AI has undoubtedly revolutionized various fields, including scientific research, instances like this highlight the need for clearer guidelines and policies regarding the use of generative AI tools.
The potential consequences of publishing inaccurate or nonsensical information can be detrimental to the scientific community’s credibility. It is crucial for publishers to establish robust mechanisms to ensure the accuracy and validity of the content they release. Additionally, researchers must exercise caution when utilizing AI tools, verifying the reliability of the generated content before submitting it for publication.
As AI continues to advance, it is essential for scientists, publishers, and reviewers to adapt their practices accordingly. The integration of AI in academia offers tremendous opportunities for innovation and discovery. However, it also demands a heightened sense of responsibility to maintain the integrity and quality of scientific research.
The publication of this paper serves as a wake-up call for the scientific community to reevaluate its approach to AI-generated content. By addressing the challenges and implementing necessary safeguards, researchers can harness the full potential of AI while ensuring that accuracy and credibility remain at the forefront of scientific progress.