Establishing reliability of dermatologist trained and validated evaluators for assessments of dermatological parameters: a comprehensive overview of concepts and techniques

Apeksha M. Merja; Nayan K. Patel; Maheshvari N. Patel; Megha K. Yadav; Nistha A. Jani

doi:10.18203/issn.2455-4529.IntJResDermatol20232540

Authors

Apeksha M. Merja NovoBliss Research Pvt. Ltd., Ahmedabad-Gandhinagar, Gujarat, India
Nayan K. Patel NovoBliss Research Pvt. Ltd., Ahmedabad-Gandhinagar, Gujarat, India
Maheshvari N. Patel NovoBliss Research Pvt. Ltd., Ahmedabad-Gandhinagar, Gujarat, India
Megha K. Yadav NovoBliss Research Pvt. Ltd., Ahmedabad-Gandhinagar, Gujarat, India
Nistha A. Jani NovoBliss Research Pvt. Ltd., Ahmedabad-Gandhinagar, Gujarat, India

DOI:

https://doi.org/10.18203/issn.2455-4529.IntJResDermatol20232540

Keywords:

Reliability, Acne, Brittle nails, IGA, Validation, Glogau skin age

Abstract

Background: Multi-centered, multi-visit outpatient dermatology studies provide participant-friendly convenience, drawing diverse volunteers while avoiding extended facility stays. However, maintaining a consistent dermatologist for such studies poses challenges, possibly leading to incomplete clinical readings and delaying accurate data collection from predefined datasets.

Methods: Led by a Dermatologist, the training aimed to ensure harmony in assessments among trained evaluators when utilizing digital photos to analyze dermatological parameters. It aimed to establish accord between the Dermatologist and Trained Evaluators for inter- and intra-observer evaluations. The training encompassed multiple parameters, such as Draize Scale, Fitzpatrick Skin Type, Glogau Skin Age Classification, IGA (Acne), PGA with Griffith Scale, and PGA for brittle nail signs.

Results: The results of the statistical analysis for photographic evaluation inter-evaluator reliability were evaluated. Based on the data, a strong correlation was observed between the Dermatologist's dataset and the Trained Evaluator's dataset. The Pearson chi-square test yielded a p-value of <0.05, indicating significant correlation among the trained evaluators' data compared to the dermatologist's data. All evaluators met the 80% acceptance criteria outlined in the training plan. Both evaluators and dermatologists were deemed suitable for dermatological assessments and photographic evaluations in relevant studies.

Conclusions: Theoretical training enabled evaluators to comprehend various dermatological parameters, including Draize Scale, Fitzpatrick Skin Type, Glogau Skin Age Classification, PGA with Griffith Scale, IGA (Acne), and PGA for brittle nail signs. Trained evaluators are now qualified to independently serve as "Dermatologist Validated and Trained Evaluators" in future studies. This approach is applicable for multi-centered, multi-visit dermatological clinical studies.

Metrics

Metrics Loading ...

References

Buranasirin P, Pongpirul K, Meephansan J. Development of a Global Subjective Skin Aging Assessment score from the perspective of dermatologists. BMC Res Notes. 2019;12(1):364.

Bhor U, Pande S. Scoring systems in dermatology. Indian J Dermatol Venereol Leprol. 2006;72:315-21.

Muhaba KA. Automatic skin disease diagnosis using deep learning from clinical image and patient information. Skin Health Dis. 2022;2:e81.

Does my study needs ethical approval, Cambridge Psychology Research Ethics Committee. Available at: https://www.bio.cam.ac.uk/psyres/approval. Accessed on 20 February 2023.

Draize J, Woodard G, Calevery H. Methods for the study of irritation and toxicity of substances applied topically to the skin and mucous membranes. J Pharmacol Experiment Therap. 1944;2:377-90.

JI Y, Kimb BK, Suh DH. The validity and practicability of sun-reactive skin type I thorough VI. Arch Dermatol. 1988;5:869-71.

Glogau RG. Chemical peeling and aging skin. J Geriatr Dermatol. 1994;2:30-5.

Draft Guidance for Industry: Acne Vulgaris: Developing Drugs for Treatment. Clinical/Medical. Available at: http://www.fda.gov/downloads/Drugs/ GuidanceComplianceRegulatoryInformation/Guidances/UCM071292.pdf. Accessed on 20 February 2023.

Griffiths C, Wang TS, Voorhees TA. A photonumeric scale for the assessment of cuteneous photodamage. Arch Dermatol. 1998;12:347-51.

Sherber NS, Hoch AM, Coppola CA, Carter EL, Chang HL, Barsanti FR, Mackay-Wiggan JM. Efficacy and safety study of tazarotene cream 0.1% for the treatment of brittle nail syndrome. Cutis. 2011;87(2):96-103.

Anthony E, Kalpadakis-Smith A. Properly training physicians in dermatology trials. Applied Clin Trials. 2021;30:8.

Green L. Explaining the role of the nurse in clinical trials. Nurs Stand. 2011;25:35-9.

Fahey T. Applying the results of clinical trials to patients to general practice: perceived problems, strengths, assumptions, and challenges for the future. Br J Gen Pract. 1998;48:1173-8.

Iwashyna TJ, Deane AM. Individualizing endpoints in randomized clinical trials to better inform individual patient care: the TARGET proposal. Crit Care. 2016; 20:218-25.

Zarbin MA. Challenges in applying the results of clinical trials to clinical practice. JAMA Ophthalmol. 2016;134:928-33.