Evidence record 9312 · automatically gathered

Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers

Large language models such as ChatGPT can produce increasingly realistic text, with unknown information on the accuracy and integrity of using these models in scientific writing. We gathered fifth research abstracts from five high-impact factor medical journals and asked ChatGPT to generate research abstracts based on their titles and journals. Most generated abstracts were detected using an AI output detector, 'GPT-2 Output Detector', with % 'fake' scores (higher meaning more likely to be gener

Record details

Published: 26 April 2023
Source: OpenAlex
Category: Research
Topics: Healthcare
Retrieved: 14 July 2026

source-onlyevidence status

These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.

How to cite this record

ethics.ai (26 April 2023), “Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers,” evidence record 9312, https://ethics.ai/record/9312 (originally published by OpenAlex).

JSON

Use and limitations

This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.