For decades, the clinical trial has reigned supreme as the "gold standard" of medical research. Built upon the pillars of meticulous randomization, rigorous bias reduction, and the pursuit of causal proof, these trials are designed to answer narrow, highly specific scientific questions. Yet, this very rigor creates a paradox: by tightly controlling the variables to isolate a drug’s effect, clinical trials often exclude the vast majority of the patient population.
In the complex, heterogeneous world of cancer care, the "average" patient often bears little resemblance to the carefully curated participants in a Phase III trial. As the medical community grapples with this disconnect, a new, data-driven frontier is emerging. Real-world data (RWD)—information derived from the day-to-day delivery of care—is no longer a secondary resource; it is becoming a foundational element in shaping the future of oncology.
The Narrow Vantage Point of Traditional Trials
The limitations of clinical trials are best illustrated by the sheer scarcity of access. According to Jeff Allen, president and chief executive officer of Friends of Cancer Research, roughly 95% of adult patients with cancer are not enrolled in clinical trials.
"Our vantage point in terms of the experience of treating cancer is relatively narrow when you think of the information that we typically see from clinical studies," Allen observes. This leaves clinicians in a difficult position. When a patient presents with comorbidities, rare genetic profiles, or advanced age—traits often screened out of trials—oncologists are forced to extrapolate from limited data. They must make critical decisions regarding treatment sequencing or drug combinations that have never been tested head-to-head.
This gap between the trial environment and the clinic floor is where the movement toward real-world evidence (RWE) finds its purpose. By tapping into the vast, unstructured ocean of clinical data, researchers are beginning to bridge the chasm between controlled efficacy and real-world effectiveness.
A Chronology of the RWD Movement
The evolution of RWD from a peripheral administrative tool to a regulatory asset has been swift and transformative. Historically, RWD was a fragmented, rudimentary affair, consisting mostly of structured insurance claims and pharmacy billing codes. It provided a "macro" view of costs and utilization, but lacked the clinical depth necessary to understand disease progression or therapeutic response.
The Digital Transformation
The rise of Electronic Health Records (EHRs) served as the first major catalyst. As digitized patient files became ubiquitous, the scope of RWD expanded to include clinical notes, laboratory results, and imaging reports. However, these records were often "messy" and unstructured, requiring significant human labor to curate into usable research data.
Regulatory Catalysts: The 21st Century Cures Act
The regulatory landscape shifted permanently in December 2016 with the signing of the 21st Century Cures Act. This landmark legislation directed the FDA to evaluate how RWE could be integrated into regulatory decision-making, particularly for new drug approvals and the expansion of existing indications.
In December 2018, the FDA released its landmark RWE framework. "The 21st Century Cures Act really acted as a catalyst in the drug and biologic space," says Donna Rivera, executive vice president of clinical evidence modernization for Canal Row Advisors and former leader of the Oncology Real World Evidence Program at the FDA’s Oncology Center of Excellence. "This evolution towards evidence for effectiveness has shown in many ways, especially in oncology and rare diseases, that real-world data can serve as pivotal evidence."
The AI Renaissance
The most recent chapter in this evolution is the integration of Artificial Intelligence (AI) and Large Language Models (LLMs). These technologies have finally unlocked the "unstructured" data trapped in clinician notes, allowing for the rapid curation of vast datasets that previously would have taken years to process.
The Mechanics of Representativeness
One of the most profound applications of RWD is in the design of future clinical trials. When researchers determine eligibility criteria, they often rely on educated guesses that may inadvertently exclude vulnerable populations.
Dr. Ankit Kansagra, a hematologist-oncologist and associate vice president of oncology integration at the Tampa General Hospital (TGH) Cancer Institute, points to hemoglobin thresholds as a classic example. "If you lower the hemoglobin from eight to seven-and-a-half grams per deciliter, what does it really do? Does it lead to poor survival in the real world?"
By analyzing RWD, researchers can simulate the impact of these criteria changes before the trial ever opens. This prevents the unnecessary exclusion of patients and ensures that the trial population is representative of the actual patient population facing the disease. However, as Dr. Kansagra notes, representativeness isn’t just about the patient—it’s about the source of the data. Data pulled solely from elite, academic cancer centers may not reflect the treatment realities of community oncology practices. To provide valid evidence, datasets must capture a diverse, multi-institutional landscape.
Context and Quality: The Regulatory Perspective
RWD is not a panacea. The medical community emphasizes that the "context" of the research question is the primary filter. Before researchers ask if data is "fit-for-use," they must ask if RWD is even the right tool for the job.
"Is the clinical context appropriate?" asks Rivera. "Does it align with real-world evidence generation, or is a clinical trial perhaps more appropriate if feasible and ethical?"
If RWD is deemed appropriate, it must then pass the "fit-for-use" test, which centers on two key pillars:
- Relevance: Does the data contain the necessary variables (e.g., patient exposures, specific outcomes, and critical covariates)? Does it capture the epidemiology of the disease in the target population?
- Reliability: Is the data accurate, complete, and trustworthy?
Reliability remains the most significant hurdle. Clinical documentation is designed for patient care, not for research. Consequently, data points—such as biomarker testing results—are often missing or inconsistently recorded across different health systems. Bridging these gaps requires sophisticated data linkage, where genomics, claims, and EHR data are merged to form a complete, longitudinal view of the patient’s journey.
Overcoming Variability and Standardization Challenges
Variability in clinical practice is a double-edged sword. While it often reflects the nuanced, compassionate tailoring of treatment to a specific patient, it creates "noise" that complicates data analysis.
"Being able to identify those sources of variability and how to manage them in the form of an analysis is really important, and that comes back to data transparency," says Jeff Allen. Without standardized definitions—such as a universal interpretation of what constitutes a "line of therapy"—comparative analysis between datasets remains difficult.
The Biomarker Gap
A persistent issue identified through RWD is the gap in standard biomarker testing. Despite clinical guidelines recommending universal testing for metastatic colorectal cancer, real-world data from organizations like Flatiron Health and Verana Health suggest that actual testing rates hover around 80%. RWD is not only exposing these gaps but is providing the evidence base needed to advocate for better adherence to clinical guidelines.
Implications for the Future of Oncology
The trajectory of real-world data points toward a future of "precision care." As AI facilitates the transformation of ambient clinical scribing into structured, actionable research data, the time lag between clinical observation and scientific insight will continue to shrink.
The ultimate goal is the development of real-time, point-of-care recommendations. Imagine a system where an oncologist, treating a patient with a rare, aggressive malignancy, can query a global, standardized, and interoperable RWD network to see how patients with an identical genetic profile responded to a specific sequence of therapies.
This vision does not replace the clinical trial; rather, it creates a symbiotic relationship. Clinical trials will continue to provide the rigorous proof for new interventions, while RWD will ensure those interventions are refined, optimized, and effectively delivered to the patients who need them most.
As the international community moves toward harmonizing guidelines and improving the interoperability of datasets, we are witnessing the birth of a new "gold standard." It is one that recognizes the limitations of the laboratory and embraces the messy, vital reality of the clinic. In this new era, every patient’s journey contributes to the collective wisdom of medicine, ensuring that the care of tomorrow is built upon the real-world experiences of today.
About the Author
