Based on combinations of disease codes and the timing of their occurrence, the model was able to predict which patients are likely to develop pancreatic cancer in the future. Notably, many of the symptoms and disease codes were not directly related to or stemming from the pancreas.
The researchers tested different versions of the AI models for their ability to detect people at elevated risk for disease development within different time scales — 6 months, one year, two years, and three years.
Overall, each version of the AI algorithm was substantially more accurate at predicting who would develop pancreatic cancer than current population-wide estimates of disease incidence — defined as how often a condition develops in a population over a specific period of time. The researchers said they believe the model is at least as accurate in predicting disease occurrence as are current genetic sequencing tests that are usually available only for a small subset of patients in data sets.
The “angry organ”
Screening for certain common cancers such as those of the breast, cervix, and prostate gland relies on relatively simple and highly effective techniques — a mammogram, a Pap smear, and a blood test, respectively.
These screening methods have transformed outcomes for these diseases by ensuring early detection and intervention during the most treatable stages.
By comparison, pancreatic cancer is harder and more expensive to screen and test for. Physicians look mainly at family history and the presence of genetic mutations, which, while important indicators of future risk, often miss many patients.
One particular advantage of the AI tool is that it could be used on any and all patients for whom health records and medical history are available, not just in those with known family history or genetic predisposition for the disease. This is especially important, the researchers add, because many patients at high risk may not even be aware of their genetic predisposition or family history.
In the absence of symptoms and without a clear indication that someone is at high risk for pancreatic cancer, clinicians may be understandably cautious to recommend more sophisticated and more expensive testing, such as CT scans, MRI or endoscopic ultrasound.
When these tests are used and suspicious lesions discovered, the patient must undergo a procedure to obtain a biopsy. Positioned deep inside the abdomen, the organ is hard to access and easy to provoke and inflame. Its irritability has earned it the moniker “the angry organ.”
An AI tool that identifies those at the highest risk for pancreatic cancer would ensure that clinicians test the right population, while sparing others unnecessary testing and additional procedures, the researchers said.
About 44 percent of people diagnosed in the early stages of pancreatic cancer survive five years after diagnosis, but only 12 percent of cases are diagnosed that early. The survival rate drops to 2 to 9 percent in those whose tumors have grown beyond their site of origin, researchers estimate.
“That low survival rate is despite marked advances in surgical techniques, chemotherapy, and immunotherapy,” Sander said. “So, in addition to sophisticated treatments, there is a clear need for better screening, more targeted testing, and earlier diagnosis, and this where the AI-based approach comes in as the first critical step in this continuum.”
Previous diagnoses portend future risk
For the current study, the researchers designed several versions of the AI model and trained them on the health records of 6.2 million patients from Denmark’s national health system spanning 41 years. Of those patients, 23,985 developed pancreatic cancer over time.
During the training, the algorithm discerned patterns indicative of future pancreatic cancer risk based on disease trajectories, that is, whether the patient had certain conditions that occurred in a certain sequence over time.
For example, diagnoses such as gallstones, anemia, type 2 diabetes, and other GI-related problems portended greater risk for pancreatic cancer within 3 years of evaluation.
Less surprisingly, inflammation of the pancreas was strongly predictive of future pancreatic cancer within an even shorter time span of two years.
The researchers caution that none of these diagnoses by themselves should be deemed indicative or causative of future pancreatic cancer. However, the pattern and sequence in which they occur over time offer clues for an AI-based surveillance model and could prompt physicians to monitor those at elevated risk more closely or test accordingly.
Next, the researchers tested the best performing algorithm on an entirely new set of patient records it had not previously encountered — a U.S. Veterans Health Administration data set of nearly 3 million records spanning 21 years and containing 3,864 individuals diagnosed with pancreatic cancer.
The tool’s predictive accuracy was somewhat lower on the US data set. This was most likely because the U.S. dataset was collected over a shorter time and contained a somewhat different patient population profiles — the entire population of Denmark in the Danish data set versus current and former military personnel in the Veterans’ Affairs data set.
When the algorithm was retrained from scratch on the U.S. dataset, its predictive accuracy improved. This, the researchers said, underscores two important points: First, ensuring that AI models are trained on high quality and rich data. Second, the need for access to large representative datasets of clinical records aggregated nationally and internationally.
In the absence of such globally valid models, AI models should be trained on local health data to ensure their training reflects the idiosyncrasies of local populations.
Authorship, funding, disclosures:
Co-authors on the study were Davide Placido, Bo Yuan, Jessica Hjaltelin, Chunlei Zheng, Amelie Haue, Piotr Chmura, Chen Yuan, Jihye Kim, Renato Umeton, Gregory Antell, Alexander Chowdhury, Alexandra Franz, Lauren Brais, Elizabeth Andrews, Debora Marks, Aviv Regev, Siamack Ayandeh, Mary Brophy, Nhan Do, Peter Kraft, Brian Wolpin, Michael Rosenthal, and Nathanael Fillmore.
The work was supported by the Novo Nordisk Foundation grants NNF17OC0027594 and NNF14CC0001; Stand Up to Cancer/Lustgarten Foundation grant SU2C6180; the National Institutes of Health grants U01 CA210171 and P50 CA127003; with additional support from the Pancreatic Cancer Action Network, the Noble Effort Fund, the Wexler Family Fund, Promises for Purple and the Bob Parsons Fund; the VA Cooperative Studies Program; the American Heart Association (857078); the Department of Defense/Uniformed Services University of the Health Sciences; the Hale Family Center for Pancreatic Cancer Research.
Brunak has ownership in Intomics A/S, Hoba Therapeutics Aps, Novo Nordisk A/S, Lundbeck A/S and ALK Abello and has managing board memberships in Proscion A/S and Intomics A/S. Wolpin has received grant funding from Celgene and Eli Lilly and consulting fees from BioLineRx, Celgene and GRAIL. Regev is a co-founder and equity holder in Celsius Therapeutics, an equity holder in Immunitas and was a scientific advisory board member of Thermo Fisher Scientific, Syros Pharmaceuticals, Neogene Therapeutics and Asimov until July 31, 2020. As of Aug. 1, 2020, Regev has been an employee of Genentech and has equity in Roche. Marks is an advisor for Dyno Therapeutics, Octant, Jura Bio, Tectonic Therapeutic and Genentech and is a co-founder of Seismic Therapeutic. Sander is on the scientific advisory board of CytoReason.
