Checking a scientific article for signs of artificial intelligence use is becoming a mandatory stage of preparing a publication. International publishers and Kazakhstani dissertation councils set requirements for disclosing the use of such technologies, and failure to comply with these requirements may result in rejection of the publication or the dissertation defence. Let us examine the criteria used in such checks and the steps that can help a scholar prepare material for submission.
Why are articles checked for the use of artificial intelligence?
The growing popularity of generative language models has led journal editorial boards and dissertation councils to pay closer attention to the origin of manuscript text. The Committee on Publication Ethics (COPE) states that artificial intelligence technologies cannot be credited as the author of a scientific work, and their use must be disclosed in the relevant section of the article. Failure to disclose such use, where signs of automatic generation are detected, may affect the decision on whether to accept the material.
Artificial intelligence detectors have their limitations
Text analysis is carried out using services that assess the probability of machine generation based on statistical characteristics. The accuracy of detecting unedited text produced by current models ranges from 75 to 95 per cent and decreases after manual editing. The result is also affected by language-specific factors – text translated from Kazakh or Russian tends to receive a higher machine-generation score, even when it has been written independently by a scholar. Factors that increase the risk of a false positive include:
- consistent formulaic constructions and standard academic phrasing
- text translated using automated translation tools
- extensive rewording carried out by grammar-correction services
- uniform sentence structure with little variation
Kazakhstan’s regulations about the use of artificial intelligence in preparing a dissertation
Under amendments made to the “Rules for the Conferral of Degrees” by Order No. 4 of the Minister of Science and Higher Education of the Republic of Kazakhstan dated 6 January 2025, the use of artificial intelligence in preparing a dissertation is permitted for the statistical sampling of variable data, while the scientific results and conclusions must be formulated independently by the scholar. The use of such technologies requires the approval of the academic supervisor and the university’s ethics committee, as well as a reference to the tool, specifying its name, version and date of use. The absence of such information is treated as confirmation that the technologies were not used.
Common mistakes when using artificial intelligence in an article
When preparing an article with the use of artificial intelligence, scholars tend to make a number of recurring mistakes:
- Using generated text without independent revision and fact-checking.
- Failing to reference the artificial intelligence tool used.
- Using services designed to artificially reduce the machine-generation percentage of a text.
- Relying entirely on the result of a single detector without cross-checking with other services.
- Translating generated text without verifying terminology and source references.
Such actions increase the likelihood of rejection of the publication or the return of the dissertation for revision.
How can an article be prepared for an artificial intelligence check before submission?
Before sending a manuscript, it is advisable to check the text independently using several services and compare the results. Any passage produced with the help of generative tools should be reworded in the scholar’s own language while retaining the scientific terminology, and the accuracy of all data and references should be verified – automatically generated literature sources may not actually exist. The use of artificial intelligence must be disclosed in accordance with the requirements of the journal or dissertation council.
Checking an article for signs of artificial intelligence use helps a scholar avoid reputational risks and delays at the review stage. Independent revision of the text and the timely disclosure of information about the technologies used remain the most reliable way of preparing material for submission.
Would you like to be confident that your article is ready for submission to an international journal? Specialists at Scientific Publications will carry out an audit of the scientific work before submission and help with the preparation of a dissertation for defence. To receive a free consultation, complete the form below, and our manager will contact you shortly. Onward to new scientific achievements!
