A Quality Assessment of the ARM-Net Registry Design and Data Collection

Background: Registries are important in rare disease research. The Anorectal Malformation Network (ARM-Net) registry is a well-established European patient registry collecting demographic, clinical, and functional outcome data. We assessed the quality of this registry through review of the structure, data elements, collected data, and user experience. Material and methods: Design and data elements were assessed for completeness, consistency, usefulness, accuracy, validity, and comparability. An intra- and inter-user variability study was conducted through monitoring and re-registration of patients. User experience was assessed via a questionnaire on registration, design of registry, and satisfaction. Results: We evaluated 119 data elements, of which 107 were utilized and comprised 42 string and 65 numeric elements. A minority (37.0%) of the 2278 included records had complete data, though this improved to 83.5% when follow-up elements were excluded. Intra-observer variability demonstrated 11.7% incongruence, while inter-observer variability was 14.7%. Users were predominantly pediatric surgeons and typically registered patients within 11–30 min. Users did not experience any significant difficulties with data entry and were generally satisfied with the registry, but preferred more longitudinal data and patient-reported outcomes. Conclusions: The ARM-Net registry presents one of the largest ARM cohorts. Although its collected data are valuable, they are susceptible to error and user variability. Continuous evaluations are required to maintain relevant and high-quality data and to achieve long-term sustainability. With the recommendations resulting from this study, we call for rare disease patient registries to take example and aim to continuously improve their data quality to enhance the small, but impactful, field of rare disease research. Level of Evidence: V.