Calculation and interpretation of indicators of informativeness of diagnostic medical technologies

The article discusses typical tasks of quantitative comparison and analysis of the effectiveness of diagnostic medical technologies. Indicators of clinical informativeness of diagnostic methods, quantitative methods for their calculation and interpretation, their importance for making diagnostic decisions are discussed. Using one of the diagnostic methods as an example, algorithms for comparing the test diagnostic test with the gold standard test according to clinical information indicators are described: sensitivity, specificity, positive and negative predictive value of test results, accuracy, likelihood ratio of positive and negative test results. The problems of constructing ROC curves by the example of diagnostic indicators of nasal obstruction: airflow and pressure, as well as the calculation and presentation of AUC (in one figure), finding diagnostic threshold points for two tests (changes in flow and resistance), and testing the statistical hypothesis about the equality of AUC of these two tests, creating a nomogram for calculating the post-test probability of illness. It is shown how, using the presented technique, it is possible to efficiently calculate all the standard operational characteristics of diagnostic medical technologies and additional useful indicators. All calculations were performed in the statistical program R. The text of the article presents program codes of the R language with explanations.

operational characteristics of diagnostic medical technologies, sensitivity, specificity, predictive value of test results, accuracy, likelihood ratio of positive and negative test results, R program, R-language

1. Linn S., Grunau P.D. New patient-oriented summary measure of net total gain in certainty for dichotomous diagnostic tests. Epidemiol Perspect Innov. 2006;3(1):11. doi: 10.1186/1742-5573-3-11.

2. DeLong E.R., DeLong D.M., Clarke-Pearson D.L. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837-845. doi: 10.2307/2531595.

3. Wasserstein R.L., Lazar N.A. The ASA’s Statement on p-Values: Context, Process, and Purpose. The American Statistician. 2016;70(2):129–133. doi: 10.1080/00031305.2016.1154108.

4. Fagan T.J. Letter: nomogram for Bayes theorem. The New England journal of medicine. 1975;293(5):257. doi: 10.1056/ NEJM197507312930513.

5. Korneenkov A.A., FantaI.V., Vyazemskaya E.E. The assessment of disease symptom dynamics using survival analysis methods. Rossiyskaya otorinolaringologiya = Russian Otorhinolaryngology. 2019;18(4):8-14. (In Russ.) doi: 10.18692/1810-4800-2019-4-8-14.

6. Korneenkov A.A., Lilenko S.V., Lilenko A.S., Vyazemskaya E.E., Bakhilin V.M. The opportunities of ROC-analysis for categorization of variables in the model for forecasting the outcome of surgical treatment in the patients with Meniere’s disease. Rossiyskaya otorinolaringologiya = Russian Otorhinolaryngology. 2019;18(3):54-59. (In Russ.) doi: 10.18692/1810-4800-2018-3-54-59.

7. Korneenkov A.A. Visualization of the results of a meta-analysis of clinical studies. Rossiyskaya otorinolaringologiya = Russian Otorhinolaryngology. 2019;18(1):8-15. (In Russ.) doi: 10.18692/1810-4800-2019-1-8-15.

8. Korneenkov A.A. Development of a scorecard for predicting clinical outcome in otorinolaryngology. Rossiyskaya otorinolaringologiya = Russian Otorhinolaryngology. 2019;18(2):25–35. (In Russ.) doi: 10.18692/1810-4800-2019-2-25-35.

9. Budkovaya M.A., Artemyeva E.S. The specific features of nasal breathing disorders in patients with nasal obstruction. Rossiyskaya otorinolaringologiya = Russian Otorhinolaryngology. 2019;18(1):16–23. (In Russ.) doi: 10.18692/1810-4800-2019-1-16-23.

10. Korneenkov A.A., Lilenko S.V., Lilenko A.S., Vyazemskaya E.E., Bakhilin V.M. The opportunities of ROC-analysis for categorization of variables in the model for forecasting the outcome of surgical treatment in the patients with Meniere’s disease. Rossiyskaya otorinolaringologiya = Russian Otorhinolaryngology. 2018;(4):62-68. (In Russ.) doi: 10.18692/1810-4800-2018-4-62-68.