Evaluating a machine learning-based risk stratification model to identify people who have injected drugs for the surveillance of blood borne viruses and sexually transmissible infections


Author: El-Hayek C, Nguyen T, Asselin J, Stoove M, Wilkinson ALW, Fairley CK, Read P, Crawford S, Madden A, Aung HL, Polkinghorne V, Boyle DIR, Hocking J, Dunn AG, and Hellard ME

Theme: Epidemiology & Public Health Research Year: 2024

Background: Monitoring blood borne viruses (BBVs) and sexually transmissible infections (STIs) among people who have injected drugs is essential to facilitating equitable access to healthcare, however injecting drug use (IDU) is not consistently screened for, disclosed or systematically recorded in most healthcare settings. We evaluated a machine learning-based risk stratification method that classifies primary care patients based on their likelihood of IDU using a large database of multi-site electronic medical records (EMRs) for surveillance.

Methods: Using a retrospective sample of de-identified EMRs from the Australian Collaboration of Coordinated Enhanced Sentinel Surveillance of STIs and BBVs, we applied a pre-trained model to generate a probability of IDU for each patient and stratified them as having high- or moderate-probability of having injected drugs. Post-hoc assessment of model behaviour compared the characteristics of model-stratified patients with patients who had pre-existing indications of IDU in their EMRs such as self-report or opioid agonist treatment.

Results: The study included 1,716,534 patients, of whom 50,235 patients (2.9%) had pre-existing IDU indications. The model classified an additional 118,986 patients (6.9% of total patients), stratified as high- (45,495; 2.7% of total) or moderate- (73,491; 4.3% of total) probability candidates. The main differences between model-classified patient profiles compared to patients with pre-existing IDU indications were a higher proportion of female patients aged 25-39 years, patients visiting general practice clinics specialising in the health of gay and bisexual men, and lower proportion of patients visiting sexual health clinics.

Conclusion: Our study demonstrated the potential for machine learning to identify patterns within the EMRs of patients likely to have injected drugs. Stratifying and characterising patients using their probability of IDU may provide an in-depth understanding of patient risk profiles, tailor interventions and improve the reach of healthcare and harm reduction. Further real-world evaluation and refinement of these methods is underway. 

Download abstract Download slides Watch video