The Calibration Trap in Synthetic Research

When a vendor tells you a synthetic persona is calibrated against your own research, hear what has actually been said. Your blind spots have been encoded, and they will now be reproduced faster, at scale, in complete sentences.

That is the calibration trap. It is the least discussed risk in this category and the most likely to cost you a decision.

The uncomfortable part is that calibration is the step that makes everyone comfortable. It is the word that gets the model past your procurement team and into a brand plan.

What is calibration, and why does it feel like rigor?

Adjusting a model's outputs until they resemble distributions you already have.

In practice that means your survey history, your tracking study, your segmentation, your syndicated category research. The vendor tunes the simulation until it produces numbers in the neighborhood of numbers you recognize. Then they show you the match.

Watch what that demonstration actually proves. It proves the model can reproduce your existing data. That is a statement about agreement, not about accuracy, and the two look identical on a slide.

Here is the circularity. You validate the model against your research. The model was tuned to match your research. Of course it matches.

Agreement with your own history is the one result the process guarantees in advance. Treating it as evidence is like marking your own exam with the answer sheet you wrote.

What exactly gets inherited?

Four things, and none of them are visible in the output.

Your sampling bias. If your research reaches the physicians who agree to be reached, the model learns that population and presents it as the market. The clinicians who never answer your surveys do not become visible because a model started generating them.

Your question design. Every survey encodes assumptions about what matters, so a model trained on your instrument inherits your framing and cannot surface the thing you never thought to ask about.

Your measurement error. If your satisfaction scores were not predicting commercial outcome before, a model grounded in them will produce confident numbers with the same predictive failure built in. Precision goes up, accuracy does not move.

Your institutional preference for comfortable answers. This one is cultural and it is the worst of the four. Research that contradicted leadership tended not to survive to the archive, so the archive leans optimistic, and now the model does too.

Each of these existed before you bought anything. What simulation changes is the speed and the confidence, which is a meaningful difference. A wrong assumption in a quarterly tracker is slow. A wrong assumption in a system that answers any question in four seconds is everywhere by Friday.

Why is pharma's historic data an especially bad anchor?

Because a lot of what you have been collecting was never predictive in the first place.

Look at the instrument that produced most of your archive. Bain's own published material says net promoter differences "explain anywhere from 10% to 70% of the variation in subsequent revenue growth rates". A range that wide is not a calibration target. It is an admission that the relationship varies enormously by context, and your context is the hardest one.

Bain made the limit explicit elsewhere, finding that goodwill is "a necessary but insufficient condition for generating revenue growth." Calibrate a model to the necessary but insufficient part and you get a necessary but insufficient model.

Your market makes it worse in three specific ways. Your customer is three people with different interests, so an aggregate sentiment score averages parties who disagree. Your patient voice is mostly missing by law, so the archive is thin exactly where the risk is highest. Your value event happens months after the data you collected, so the historic file rarely contains the outcome worth predicting.

I have set out why borrowed instruments break here in does NPS work with physicians and why consumer CX does not translate to pharma.

How would you know it has happened to you?

Four signs, and you can check all four this week.

The model never surprises you. Everything it returns is something somebody in the room already believed. Agreement is the symptom, not the proof.

It has no opinion about your known failures. Ask it where patients abandon your therapy and see whether it finds the seam your own field force complains about. If it cannot name a problem you already know is real, it does not know your market.

It is confident about things your data never covered. A model grounded in physician research will still answer a question about payer committee politics, fluently, with nothing underneath it.

Its error rate has never been published. Not a fidelity score the vendor computed, a comparison against realized outcomes. That protocol is set out in how to validate a synthetic audience.

What should you calibrate against instead?

Behavior that cost somebody something, and outcomes that exist independently of your research function.

Replace sentiment anchors with progression anchors wherever you can.

Script to start conversion. Time to therapy. Persistence at six and twelve months. Barrier resolution speed. Those are observable, they have a price attached, and nobody filled in a form to produce them.

There is plenty of external truth to anchor against. A 2026 JAMA study summarized by Johns Hopkins found insurer rejections reached 40.7% of initial brand name attempts in 2024. Of those rejected scripts, 48.4% were never followed by any fill in that class within 90 days. Calibrate to that and you are anchored to something the market did, not something it said.

Use your frontline as the correction layer. Your field force, hub agents and patient support staff observe failures that never reach a survey, which makes them the cheapest independent check you own. That route is in voice of the frontline.

Then hold the whole thing against the measures in how to measure customer experience in pharma. A model calibrated to a scorecard that does not move money will produce advice that does not move money.

Does this mean you should not calibrate?

No. It means calibrate to outcomes rather than to opinions, and keep a record of what you calibrated to.

Three rules make it workable.

Write down the anchor. Whatever the model was tuned against goes in a document that travels with every output, so a reader knows which archive is speaking.

Weight observed data above stated data in the anchor set. When both exist, behavior wins, and your vendor should be able to tell you the ratio.

Hold back a cohort the model has never seen and never will. One clean holdout, protected, used only for scoring. The moment it becomes training material you have lost your only independent read.

Do all three and calibration goes back to being what the word implies, which is an instrument checked against reality rather than against your own filing cabinet.

Why does this matter more than it sounds?

Because your industry has already demonstrated it can believe a comfortable number for years.

Deloitte's 2025 research found that only 28% of HCPs believe pharma's engagement strategies meet their needs, against 82% of life sciences executives who say they are satisfied with those same strategies. That 54 point spread was produced by human beings reading their own research.

Now imagine that archive turned into a system that answers instantly and never hesitates. The 82% view gets automated, and the 28% view has no route in at all. Nobody notices, because the output still sounds like research.

The layer that would have told you the truth is the one simulation structurally cannot reach, which is Predisposition. The whole argument this sits inside is the future of the pharma commercial model, and the discipline that keeps listening honest is Customer Excellence.

Calibration is not the enemy. Calibrating to yourself is.

Key takeaways

  • Calibrating a synthetic persona against your own research guarantees agreement with your archive, which is not the same as accuracy.
  • Four things get inherited invisibly: your sampling bias, your question design, your measurement error and your preference for comfortable answers.
  • Pharma's archive is a poor anchor because much of it came from sentiment instruments that never predicted commercial outcome.
  • If the model never surprises you and has no view on failures you already know are real, it has learned your file rather than your market.
  • Anchor to behavior with a cost attached, record the anchor in writing, and protect one cohort the model will never see.

Questions to ask your research team

  1. What exactly was our model calibrated against, and is that written down anywhere a reader of the output would find it?
  2. In the anchor set, what is the ratio of observed behavior to stated opinion?
  3. Which cohort have we protected from the model, and who is enforcing that?
  4. Name one thing the simulation has told us that nobody in the room already believed.
  5. If our old satisfaction data was not predicting revenue, what are we expecting a model trained on it to do?

About the author

Wayne Simmons is the founder of The Customer Excellence AGENCY and the author of The Customer Excellence Enterprise (Wiley, 2024). He is founding faculty of the MS in Customer Experience Management at Michigan State University's Broad College of Business. He led global customer excellence in Pfizer's first Chief Marketing Organization and in Bayer's Customer Powerhouse. Related reading: How to validate a synthetic audience, What is a synthetic persona? and Voice of the customer in pharma, three ways to hear

March 15, 2026
Why healthcare professionals now judge pharmaceutical engagement against the best experiences in their lives, and what that means for the future of commercial leadership. When commercial performance falters, the reflex inside many pharmaceutical organizations is to adjust the machinery of field execution. Leaders revisit call plans, recalibrate targeting models, and increase the volume of activity in the hope that more precision or more frequency will restore momentum. For decades this system has been treated as the central instrument of commercial performance, determining which physicians are prioritized, how frequently representatives engage, and how resources are deployed across territories. Yet the growing gap between commercial effort and commercial impact suggests a deeper issue. T he problem is rarely the design of the call plan itself. It is the context in which healthcare professionals now operate. Physicians are navigating increasingly complex clinical, administrative, and informational environments, and that evolving reality now shapes prescribing behavior far more than the cadence of promotional interactions. What many organizations are experiencing is a widening Customer Context Gap. Commercial systems were designed for a time when prescribing decisions could be influenced primarily through promotional interaction and product information. Today physicians operate inside a far more complex reality shaped by administrative burden, reimbursement constraints, digital information overload, and growing expectations for seamless support across the entire care journey. In this environment the physician’s decision is influenced not only by clinical evidence but also by how easily a therapy fits into the practical realities of care delivery. When commercial models remain anchored in promotional activity while the customer’s context has fundamentally changed, even the most disciplined call plan struggles to deliver the outcomes it was designed to produce. Closing this gap requires a different way of thinking about commercial performance. The question is no longer how to optimize promotional activity but how to align the organization around the real journeys through which physicians help patients receive therapy. Prescribing decisions unfold within complex sequences of clinical evaluation, reimbursement navigation, patient readiness, and ongoing support. When commercial strategy is designed around these journeys rather than isolated interactions, the role of the field force begins to evolve. Representatives are no longer positioned primarily as messengers of information but as partners in removing barriers that slow care. Organizations that recognize this shift begin redesigning their commercial systems accordingly, aligning field engagement, digital support, access programs, and patient services around the same goal: helping healthcare professionals help patients move from clinical intent to successful treatment. From Promotional Activity to Customer Journeys The pharmaceutical industry has historically organized commercial activity around the moment of promotion. Call plans, targeting models, and message sequencing were designed to influence prescribing behavior primarily through informational engagement with healthcare professionals. While this model brought structure and scale to commercial operations, it reflects an earlier era in which the path from clinical awareness to prescribing action was comparatively linear. Today the journey is far more complex. Physicians must navigate an intricate landscape of clinical evidence, treatment guidelines, payer requirements, prior authorization processes, patient affordability concerns, and adherence challenges. Prescribing a therapy is no longer a single decision point. It is the beginning of a chain of events that determines whether a patient ultimately receives and remains on treatment. This is why the commercial conversation must expand beyond the traditional moment of prescription to encompass three interconnected journeys. The first is the Path-to-Prescribe , where scientific evidence, clinical education, and confidence in the therapy shape the physician’s willingness to recommend treatment. The second is the Path-to-Fulfill, where access, affordability, patient readiness, and operational support determine whether that recommendation ultimately becomes therapy in the patient’s hands. The third is the Path-to-Adhere , where ongoing patient support, monitoring, and engagement determine whether patients remain on therapy long enough to realize the intended clinical benefit. Science drives the Path to Prescribe, where evidence, clinical education, and confidence in the therapy shape the physician’s willingness to recommend treatment. Experience shapes the Path to Fulfill, where access, affordability, and patient readiness determine whether that recommendation becomes therapy in the patient’s hands. Sustained outcomes depend on the Path to Adhere, where ongoing support, monitoring, and engagement ensure patients remain on therapy long enough to realize its intended clinical benefit. When commercial organizations focus almost exclusively on the first while leaving the latter journeys fragmented and burdened, a significant portion of therapeutic value is lost between intention and impact. In many therapeutic areas, the result appears in the persistent gap between prescriptions written, prescriptions filled, and therapies sustained—gaps that reflect not a failure of science but a failure of system design. Recognizing these three journeys shifts the unit of focus from promotional activity to the real-world pathways through which care is delivered. It reframes the role of the field force, the purpose of digital engagement, and the design of patient support programs around a single objective: reducing the friction that stands between clinical intent, treatment initiation, and sustained patient outcomes. Customer Context Is the New Commercial Variable For much of the pharmaceutical industry’s history, commercial performance was largely explained by a familiar set of variables. Product efficacy, clinical differentiation, promotional reach, and sales force execution determined the trajectory of most brands. When performance lagged, leaders adjusted those levers by refining segmentation, optimizing targeting, and recalibrating call plans. Today those traditional levers still matter, but they no longer explain commercial outcomes on their own. A far more powerful variable has entered the equation: customer context. HCPs now operate within an environment defined not only by clinical complexity and administrative burden but also by rising expectations shaped by their experiences outside healthcare. Physicians are also consumers. In their personal lives they interact daily with companies such as Apple, Amazon, Tesla, and Netflix that anticipate their needs, remove friction, and simplify complex processes through thoughtful design. These experiences quietly reset the benchmark for competence, responsiveness, and respect for their time. When those same physicians step into their clinical roles, they do not shed those expectations. They carry them with them. The contrast between the seamless orchestration of their consumer experiences and the fragmented systems surrounding many healthcare interactions becomes difficult to ignore. What once felt acceptable now feels unnecessarily burdensome. This dynamic represents the Consumer-Grade Imperative. Healthcare professionals increasingly evaluate pharmaceutical engagement not against other pharmaceutical companies but against the best experiences they encounter anywhere in their lives. In this environment even a clinically superior therapy can struggle if the surrounding system makes it difficult to initiate treatment, navigate reimbursement, or support patient adherence. Customer context therefore becomes the new commercial variable. It determines whether scientific differentiation translates into practical adoption. It shapes whether prescribing intent becomes therapy initiation and whether therapy initiation becomes sustained patient outcomes. Call plans were designed to manage activity. Customer context requires organizations to manage journeys. The Field Force in the Era of Customer Context Recognizing customer context as the defining commercial variable inevitably reshapes how the role of the field force is understood. For decades the pharmaceutical sales representative has been positioned primarily as the carrier of scientific information. Call plans optimized the frequency and sequencing of these interactions to ensure that physicians received consistent messaging. That role does not disappear, but the environment surrounding it has changed profoundly. Physicians today are navigating administrative burden, payer complexity, digital information overload, and increasing time pressure. In this environment they are not simply seeking more information. They are seeking clarity, simplicity, and support that helps them navigate the complexity surrounding treatment decisions. This shift transforms the representative from a messenger of information into something far more valuable: a partner in removing friction from the care journey. Conversations move beyond repeating clinical claims toward understanding the practical barriers that physicians and their teams face as they attempt to initiate and sustain therapy for patients. The most effective field forces are therefore supported by commercial systems designed around journeys rather than activities. Representatives are equipped not only with scientific messaging but with the insight and coordination required to address obstacles across prescribing, reimbursement, and patient support. Field engagement becomes a catalyst for problem solving rather than simply a vehicle for promotion. From Call Plans to Customer-Aligned Commercial Systems If customer context has become the defining commercial variable, then the systems designed to support the field must evolve accordingly. The traditional call plan was built to manage activity. It provided structure for how frequently physicians were engaged, how territories were covered, and how resources were deployed. Yet activity alone does not determine whether therapies ultimately reach patients. What determines impact is whether the commercial system surrounding the physician reduces or increases the burden of delivering care. A customer-aligned commercial system begins with the journeys through which physicians help patients move from diagnosis to treatment and beyond. Marketing clarifies the scientific story. Sales provides trusted relationships and real-time understanding of physician needs. Access teams simplify reimbursement pathways. Patient support programs reduce administrative burden. Digital engagement reinforces and extends human interaction. The result is a commercial system that operates less like disconnected functions and more like an integrated network designed to help physicians help patients. This is the essence of Customer Excellence. It aligns the entire commercial enterprise around the real-world context in which care is delivered. The problem was never the call plan. The problem was the context. Key Takeaways Commercial performance in pharma organizations has traditionally been managed through field execution mechanics, yet the effectiveness of those mechanics increasingly depends on how well they reflect the real-world context in which physicians operate. Customer context has become the most pivotal commercial variable as administrative burden, payer complexity, and consumer-grade expectations reshape how prescribing decisions are made. HCPs now evaluate pharmaceutical engagement against the best experiences they encounter anywhere in their lives, raising the standard for clarity, responsiveness, and ease. Optimizing promotional activity alone is no longer sufficient. Commercial success depends on reducing friction across the journeys physicians navigate as they move patients from diagnosis to treatment. Customer Excellence represents the structural response, aligning marketing, sales, access, digital engagement, and patient support around the real journeys of care delivery . Diagnostic Questions to Consider Are we optimizing the activity of our field force, or designing commercial systems that support the real journeys physicians navigate to help patients receive therapy? How well do we understand the administrative, reimbursement, and operational barriers physicians encounter after they decide to prescribe a therapy? Do our commercial systems reduce the burden placed on physicians and their staff , or unintentionally add to the complexity of care delivery? Are we benchmarking our engagement against other pharma companies , or against the best experiences physicians encounter in their lives as consumers? Have our investments in digital platforms simplified the physician’s experience, or multiplied the number of disconnected interactions they must manage? Are we still managing performance through activity metrics alone , or beginning to understand the context that ultimately determines whether therapies reach patients? Closing Reflection The pharma and life sciences industry has spent decades refining the mechanics of field execution. Call plans, segmentation models, and targeting systems brought structure and discipline to commercial organizations. Yet the environment surrounding physicians has evolved far more rapidly than the systems built to support them. Healthcare professionals now operate in a world defined by consumer-grade expectations for clarity, responsiveness, and ease. When the experience of engaging with a pharmaceutical company fails to reflect those expectations, the contrast becomes impossible to ignore. Organizations that recognize this shift will redesign their commercial systems around the realities of modern care delivery. They will move beyond managing activity and toward understanding the context in which physicians help patients receive treatment. In doing so they will close the gap between scientific innovation and real-world impact. Your breakthrough science deserves experiences worthy of it. Together, we turn customer excellence into real-world impact. About the Author Wayne Simmons is a hands-on commercial excellence architect and founder of The Customer Excellence Agency, where he partners with pharmaceutical and life sciences leaders to turn customer-centric ambition into durable commercial advantage. He previously served as Global Customer Excellence Lead within Pfizer’s Chief Marketing Organization and has held leadership roles with Bayer Pharmaceuticals and The Ritz-Carlton Leadership Center. Wayne writes The Customer-Centric Marketer newsletter and is the author of The Customer Excellence Enterprise: A Playbook for Creating Customers for Life. The Customer Excellence Agency: Advancing the Pursuit of Excellence in Service of Science.
Tan building with a hanging sign against a clear blue sky
By Wayne Simmons • June 12, 2025
Part five of the Starbucks Customer Excellence Series. Reconstructing the brand pyramid so that experience, not just product, carries the promise.
Coffee shop barista serving drinks behind the counter with menu boards and espresso machines.
By Wayne Simmons • June 12, 2025
Part four of the Starbucks Customer Excellence Series. Why corporate culture stays abstract until it is defined as a platform for delivering the experience.
Industrial-style café with large windows, people seated at tables, and a bright wooden counter
By Wayne Simmons • June 12, 2025
Part three of the Starbucks Customer Excellence Series. What the brand lost when it scaled, and what recapturing its mystique would require.
A starbucks logo is on the screen of a cell phone
By Wayne Simmons • June 12, 2025
Part two of the Starbucks Customer Excellence Series. How a highly successful digital innovation can erode the experience it was built to serve.
Starbucks sign on a beige building against a clear blue sky
By Wayne Simmons • June 12, 2025
The final part of the Starbucks Customer Excellence Series. How an experience delivery system is redesigned so excellence is repeatable rather than heroic.