Computer analysis of the emotional modality of 20 million publications in PUBMED database indicates ways to increase the effectiveness of pharmacotherapy by identifying pseudoscientific publications aimed at negative emotional "pumping" of doctors

The search for original publications on fundamental and clinical medicine that would produce results of the highest scientific quality represents an urgent need for every medical researcher. Such publications are essential, in particular, for the development of reliable treatment standards. The Englishlanguage resources PUBMED and EMBASE are essential to help in solving this problem. However, there is an obvious problem in assessing the quality of the studies found. The paper formulates a method for analyzing the texts of biomedical publications, which is based on an algorithmic assessment of the emotional modality of medical texts (so-called sentiment analysis). The use of the topological theory of data analysis made it possible to develop a set of high-precision algorithms for identifying 16 types of sentiments (manipulative turns of speech, research without positive results, propaganda, falsification of results, negative personal attitude, aggressiveness of the text, negative emotional background, etc.). On the basis of the developed algorithms, a point scale for assessing the sentiment quality of research was obtained, which we called the "β-score": the higher the β-score, the less the evaluated text contains manipulative language constructions. As a result, the ANTIFAKE system (http://antifake-news.ru) was developed to analyze the sentiment-quality of Englishlanguage scientific texts. An analysis of ~ 20 million abstracts from PUBMED showed that publications with low sentiment quality (β-score <0, that is, that the prevalence of manipulative constructions over meaningful ones) is only 19 %. In the overwhelming majority of thematic headings (27,090 out of 27,840 headings of the MESH system PUBMED), a positive dynamics of sentiment quality of the texts of publications is shown by years). At the same time, as a result of the study, 249 headings were identified with sharply negative dynamics of sentiment quality and with a pronounced increase in manipulative sentiments characteristic of the "yellow" English-language press. These headings include tens of thousands of publications in peer-reviewed journals, which are aimed at (1) legalizing ethically unacceptable practices (euthanasia, perversions, so-called "population control", etc.), (2) discrediting psychiatry as a science, (3) media the war against micronutrients and (4) discrediting evidence-based medicine under the guise of developing the so-called "international standards of evidence-based medicine". In general, the developed system of artificial intelligence allows researchers to filter out pseudoscientific publications, the text of which is overloaded with emotional manipulation and which are published under the guise of "evidence-based standards".

1. Sanders S, Del Mar C. Clever searching for evidence. BMJ. 2005;330(7501):1162-3. DOI: 10.1136/bmj.330.7501.1162.

2. Ramos K, Linscheid R, Schafer S. Real-time information-seeking behavior of residency physicians. Fam Med. 2003;35(4):257–260.

3. Torshin IYu. Bioinformatics in the post-genomic era: physiology and medicine. Nova Biomedical Books, NY, USA (2007). ISBN 1-60021-048-1.

4. Gromova OA, Torshin IYu. Vitamin D. Smena paradigm, 2-e izdanie, pererabotannoe i dopolnennoe / Ed by EI Gusev, IN Zakharova. Moscow: GEOTAR-Media; 2021. (In Russ). ISBN 978-5-9704-5787-0.

5. Stewart Chaplin. “The Stained Glass Political Platform”. The Century Magazine, USA, 1900.

6. Summers E. Weasel Words: 200 Words You Shouldn't Trust: 200 Words You Can't Trust. Chambers (Ed.), Slang & Idiom Dictionaries, 2009. ISBN13: 978-0550104762.

7. Watson D. Watson's Dictionary of Weasel Words, Contemporary Cliches, Cant and Management Jargon. Knopf; 1st Ed. 2004. ISBN-10: 1740513215, ISBN-13: 978-1740513210.

8. Torshin IYu, Rudakov KV. Combinatorial analysis of the solvability properties of the problems of recognition and completeness of algorithmic models. Part 1: factorization approach. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications). 2017;27(1):16–28. DOI: 10.1134/S1054661817010151.

9. Torshin IYu, Rudakov KV. Combinatorial analysis of the solvability properties of the problems of recognition and completeness of algorithmic models. Part 2: metric approach within the framework of the theory of classification of feature values. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications). 2017;27(2):184–199. DOI: 10.1134/S1054661817020110.

10. Torshin IYu. Optimal dictionaries of the final information on the basis of the solvability criterion and their applications in bioinformatics. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications). 2013;23(2):319-327. DOI: 10.1134/S1054661813020156.

11. Torshin IYu, Rudakov KV. On the theoretical basis of the metric analysis of poorly formalized problems of recognition and classification. Pattern Recognition and Image Analysis. 2015;25(4):577–587. DOI: 10.1134/S1054661815040252.

12. Torshin IYu, Rudakov KV. On metric spaces arising during formalization of problems of recognition and classification. Part 1: properties of compactness. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications). 2016;26(2):274–284. DOI: 10.1134/S1054661816020255.

13. Torshin IYu, Rudakov KV. On metric spaces arising during formalization of problems of recognition and classification. Part 2: density properties. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications). 2016;26(3):483–496. DOI: 10.1134/S1054661816030202.

14. Torshin IYu, Rudakov KV. On the application of the combinatorial theory of solvability to the analysis of chemographs. Part 1: fundamentals of modern chemical bonding theory and the concept of the chemograph. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications). 2014;24(1):11–23. DOI: 10.1134/S1054661814010209.

15. Torshin IYu, Rudakov KV. On the application of the combinatorial theory of solvability to the analysis of chemographs. Part 2: local completeness of invariants of chemographs in view of the combinatorial theory of solvability. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications). 2014;24(2):196-208. DOI: 10.1134/S1054661814020151.

16. Torshin IYu, Rudakov KV. On the Procedures of Generation of Numerical Features Over Partitions of Sets of Objects in the Problem of Predicting Numerical Target Variables. Pattern Recognition and Image Analysis. 2019;29(4):654–667. DOI: 10.1134/S1054661819040175.

17. Chernyshev VM. Mech Oboyudoostryj. Konspekt po Sektovedeniyu. Moscow: Nobel Press; 2011. (In Russ). ISBN 9785424134425.

18. Dworkin A.L. Sektovedenie: Totalitarnye sekty. Opyt sistematicheskogo issledovaniya. 3-e izd., pererab. i dop. Nizhny Novgorod: Hristianskaya biblioteka; 2014. (In Russ). ISBN 978-5-905472-03-9, 978-5-905472-21-3.

19. Okter A. Mastermind: The Truth of the British Deep State. Arashtirma Publishing. 2017; 698 pp.

20. Popper K. R. Conjectures and Refutations. The Growth of Scientific Knowledge. Moscow: OOO «Izdatel'stvo ACT»: ZAO NPL «Ermak»; 2004. (In Russ). ISBN 5-17-012641-7; ISBN 5-9577-0652-3.

21. Arnold V, Ilyashenko Yu, Anosov D, et al. Dinamicheskie sistemy – 1. Itogi nauki i tekhn. Ser. Sovrem. probl. mat. Fundam. napravleniya. Moscow: VINITI. 260 p. (In Russ).

22. Levenshtein VI. Dvoichnye kody s ispravleniem vypadenij, vstavok i zameshchenij simvolov. Doklady Akademij Nauk USSR. 1965;163(4):845-848. (In Russ).

23. Ioannidis JPA. Hijacked evidence-based medicine: stay the course and throw the pirates overboard. J Clin Epidemiol. 2017 Apr; 84:11-13. DOI: 10.1016/j.jclinepi.2017.02.001.

24. Ioannidis JP. Evidence-based medicine has been hijacked: a report to David Sackett. J Clin Epidemiol. 2016 May; 73:82–86. DOI: 10.1016/j.jclinepi.2016.02.012.

25. Møller MH, Ioannidis JPA, Darmon M. Are systematic reviews and meta-analyses still useful research? We are not sure. Intensive Care Med. 2018 Apr; 44(4):518-520. DOI: 10.1007/s00134-017-5039-y.

26. Cochrane is a registered trademark in Australia, Canada, the European Community and the USA. 2017-09-19. [Internet] URL: trademarks.justia. com/791/85/cochrane-79185910.html. Дата обращения: 12.12.2019.

27. Torshin IYu, Gromova OA, Kobalava ZhD. About errors in meta-analyses of cardiovascular effects of omega-3 PUFA. Part 1. Pharmacological and clinical aspects of validity in the era of post-genomic research, artificial intelligence and big data analysis. Effektivnaya farmakoterapiya. 2019;15(9):26- 34. (In Russ). DOI: 10.33978/2307-3586-2019-15-9-26-34.

28. Torshin IYu, Gromova OA, Kobalava ZhD. About errors in meta-analyses of cardiovascular effects of omega-3 PUFA. Part 2. Intellectual analysis and meta-analysis of clinically homogeneous studies. Effektivnaya farmakoterapiya. 2019;15(9):36–43. (In Russ). DOI: 10.33978/2307-3586-2019-15-9-36-43.

29. Limanova OA, Torshin IYu, Sardaryan IS et al. Micronutrient provision and women’s health: intellectual analysis of clinicoepidemiological data. Gynecology, obstetrics and perinatology. 2014;13(2):5–15. (In Russ).

30. Gromova OA, Torshin IYu, Gromov AN et al. Data mining in course and outcome of pregnancy: role of vitamin and mineral complexes. Medical alphabet. 2018;1(6):10–23. (In Russ).

31. Gromova OA, Torshin IYu. Vitamin D. Smena paradigmy / Ed by EI Gusev, IN Zakharova. Moscow: GEOTAR-Media; 2017. (In Russ). ISBN 978-5-9704-4058-2.

32. Hannemann A, Wallaschofski H, Nauck M et al. Vitamin D and health care costs: Results from two independent population-based cohort studies. Clin Nutr. 2018 Dec;37(6 Pt A):21490–2155. DOI: 10.1016/j.clnu.2017.10.014.

33. Mechanic AG. Iskusstvennyj intellekt na strazhe zdorov'ya. Beseda vtoraya s OA Gromova i IYu Torshin. Stimul: ZHurnal ob innovaciyah v Rossii. 2019;15(9):36–43. [Internet]. [cited October 30, 2019]. (In Russ).]. URL: https://stimul.online/articles/science-and-technology/iskusstvennyyintellekt-na-strazhe-zdorovya-beseda-vtoraya/. Аccessed on: 23.06.2020.

34. Nacional'naya programma «Nedostatochnost' vitamina D u detej i podrostkov Rossijskoj Federacii: Sovremennye podhody k korrekcii». Moscow, 2018. Soyuz pediatrov Rossii. FGAU «Nacional'nyj medicinskij issledovatel'skij centr zdorov'ya detej» Minzdrava Rossii. FGBOU DPO «Rossijskaya medicinskaya akademiya nepreryvnogo professional'nogo obrazovaniya» Minzdrava Rossii. FGBUN «Federal'nyj issledovatel'skij centr pitaniya, biotekhnologii i bezopasnosti pishchi». (In Russ).

35. Krotov G, Nikitina M, Rodchenkov G. Possible cause of lack of positive samples on homologous blood transfusion. Drug Test Anal. 2014 Nov-Dec;6(11-12):1160–1162. DOI: 10.1002/dta.1736.

36. Allsopp K et al. Heterogeneity in psychiatric diagnostic classification. Psychiatry Res. 2019 Sep;279:15-22. DOI: 10.1016/j.psychres.2019.07.005.

37. Fedin AI. Prezident RF podpisal zakon o klinicheskih rekomendaciyah. Nevron'yus: novosti Nevrologii. 2019;1(51):1. (In Russ).

38. Zhuravleva NI, Shubina LC, Sukhorukikh OA. The use of the level of evidence and grade of recommendations scales in developing clinical guidelines in the Russian Federation. Modern Pharmacoeconomics and Pharmacoepidemiology [FARMAKOEKONOMIKA. Sovremennaya farmakoekonomika i farmakoepidemiologiya]. 2019;12(1):34–41. (In Russ). DOI: 10.17749/2070-4909.2019.12.1.34-41.

39. Omelyanovsky VV, Fedyaeva VK, Musina NZ. The concept of multicriteria analysis of decision-making in the current system of health technology assessment in Russia. Farmakoekonomika. Modern pharmacoeconomics and pharmacoepidemiology. [Farmakoekonomika. Sovremennaya farmakoekonomika i farmakoepidemiologiya]. 2018;11(3):003–007. (In Russ). DOI: 10.17749/2070-4909.2018.11.3-003-007.

40. Khrustalev MB, Maksimova AA. Effective search for potentially innovative scientific results in medicine. FARMAKOEKONOMIKA. Modern Pharmacoeconomics and Pharmacoepidemiology [Farmakoekonomika. Sovremennaya farmakoekonomika i farmakoepidemiologiya]. 2019;12(1):27–33. DOI: 10.17749/2070-4909.2019.12.1.27–33.