We use cookies to understand how you use our site and to improve your experience. This includes personalizing content and advertising. To learn more, click here. By continuing to use our site, you accept our use of cookies. Cookie Policy.

Features Partner Sites Information LinkXpress
Sign In
Advertise with Us

Download Mobile App

AACC Competition Demonstrates How Labs Can Use Data Analytics to Solve Real Problems

By LabMedica International staff writers
Posted on 17 Oct 2022
Print article
Image: Advances in machine learning and data analytics are transforming the field of laboratory medicine (Photo courtesy of AACC)
Image: Advances in machine learning and data analytics are transforming the field of laboratory medicine (Photo courtesy of AACC)

Clinicians rely on parathyroid hormone-related peptide (PTHrP) measurement to help establish a diagnosis of humoral hypercalcemia of malignancy - a rare form of cancer that causes, among other things, high levels of calcium in the blood. The problem: Clinicians often order it for patients with low pretest probability. Excessive PTHrP testing can lead to expensive, unnecessary, and potentially harmful procedures, including invasive laboratory testing to locate a possibly nonexistent cancerous tumor. A successful predictive algorithm would help laboratorians quickly and accurately identify potentially inappropriate PTHrP test orders by predicting whether laboratory data available at the time of order already suggest an abnormal PTHrP result. A machine-learning challenge introduced for the first time by the American Association for Clinical Chemistry (Washington, DC, USA; www.aacc.org) at the 2022 AACC Annual Scientific Meeting & Clinical Lab Expo demonstrated how laboratories can use data analytics to solve these real problems facing patients and clinicians.

The Predicting PTHrP Results Competition introduced by the AACC at the event in association with the informatics section in the department of pathology and immunology of Washington University School of Medicine, St. Louis (WUSM, St. Louis, MI, USA) aimed to engage the community of laboratory medicine practitioners in a fun and friendly online environment where they could practice their data analytics skills, learn from each other, and see how others approach problems on the data-driven side of laboratory medicine. Competition participants formed teams and used securely shared real, de-identified clinical data from PTHrP orders at WUSM to build their predictive algorithms. This is termed the “practice dataset”. Using real clinical data was a big deal because most machine-learning competitions use synthesized datasets. Organizers set up the competition using Kaggle, a popular online platform for machine-learning modeling and contests, and selected F1 score (the harmonic mean of sensitivity and specificity) as the performance metric.

A major challenge for the teams was developing a predictive model that achieved high accuracy without overfitting it to the public dataset (the practice dataset). Overfitting would mean the algorithm worked well on the initial data but failed if applied to new data and was not generalizable. Organizers used a second, private dataset to judge the algorithm’s effectiveness. From May to June 2022, 24 teams ran a total of 395 iterations of their predictive models through the public dataset. Each time a team submitted a predictive model for an attempt, they used the resulting F1 score to improve - or “train” - the model. For the final attempt, each team ran their predictive model through the private dataset. The winning team, Team Kagglist, achieved an F1 score of 0.9 with their predictive model. For reference, WUSM’s manual approach for identifying patients at risk for PTHrP had an F1 score of 0.6, making the algorithm a significant improvement over standard practice.

“We shouldn’t expect a predictive model trained on data from one hospital to automatically work at other hospitals,” said Team Kaggle’s Yingheng Wang. “Ultimately, we should aim to create adaptive models that can be fine-tuned by other institutions for their specific populations.”

“The quality of all 24 models was excellent and showed a high degree of accuracy for the very difficult task we challenged participants with,” said competition organizer Mark Zaydman, MD, PhD, an assistant professor of pathology and immunology at WUSM. “This competition really showed our community is ready to engage with sophisticated machine learning and data analytics tools.”

Related Links:

Platinum Supplier
COVID-19 Rapid Test
OSOM COVID-19 Antigen Rapid Test
Gold Supplier
DNA Extraction Kit
MagMAX DNA Multi-Sample Ultra 2.0 Kit
POCT Fluorescent Immunoassay Analyzer
Automated Staining Unit
RAL Stainer

Print article


Clinical Chemistry

view channel
Image: A module with eight micro-devices, complete with microfluidic channels and drive motors (Photo courtesy of U.S Department of Energy)

Highly Sensitive pH Sensor to Aid Detection of Cancers and Vector-Borne Viruses

Understanding the acidity or alkalinity of substances through pH measurement is crucial in many fields, from environmental monitoring to healthcare product safety. In many cases, these measurements must... Read more

Molecular Diagnostics

view channel
Image: Newly identified biomarkers may detect early cognitive decline via a blood test (Photo courtesy of 123RF)

Blood Tests to Enable Early Identification of Cognitive Decline and Personalized Treatments

Some individuals who have endured extreme stressors like psychiatric disorders or childhood abuse and neglect can experience a variety of health issues later in life, such as depression, anxiety, and cardiovascular... Read more


view channel
Image: The QScout hematology analyzer has received US FDA 510(k) clearance (Photo courtesy of Ad Astra Diagnostics)

First Rapid-Result Hematology Analyzer Reports Measures of Infection and Severity at POC

Sepsis, a critical medical condition that arises as an extreme response to infection, poses a significant health threat. It occurs when an infection triggers a widespread inflammatory response in the body.... Read more


view channel
Image: PointCheck is the world’s first device for non-invasive white cell monitoring (Photo courtesy of Leuko Labs)

World’s First Portable, Non-Invasive WBC Monitoring Device to Eliminate Need for Blood Draw

One of the toughest challenges for cancer patients undergoing chemotherapy is experiencing a low count of white blood cells, also known as neutropenia. These cells play a crucial role in warding off infections.... Read more


view channel
Image: Current testing methods for antibiotic susceptibility rely on growing bacterial colonies in the presence of antibiotics (Photo courtesy of 123RF)

Rapid Antimicrobial Susceptibility Test Returns Results within 30 Minutes

In 2019, antimicrobial resistance (AMR) was responsible for the deaths of approximately 1.3 million individuals. The conventional approach for testing antimicrobial susceptibility involves cultivating... Read more


view channel
Image: AI methods used in satellite imaging can help researchers analyze tumor images (Photo courtesy of Karolinska Institutet)

AI Approach Combines Satellite Imaging and Ecology Techniques for Analysis of Tumor Tissue

Advancements in tumor imaging technology have significantly enhanced our ability to observe the minute details of tumors, but this also brings the challenge of interpreting vast amounts of data generated... Read more


view channel
Image: Made-to-order diagnostic tests may soon be on the horizon (Photo courtesy of McGill University)

Breakthrough in Diagnostic Technology Could Make On-The-Spot Testing Widely Accessible

Home testing gained significant importance during the COVID-19 pandemic, yet the availability of rapid tests is limited, and most of them can only drive one liquid across the strip, leading to continued... Read more
Copyright © 2000-2023 Globetech Media. All rights reserved.