The Silver Wooden Spoon: Replacing Sensitive Human Conversations
Second place among my worst or most dangerous uses of AI in healthcare market research goes to replacing sensitive human conversations without considering what those conversations require.
Automated interviewing can have a role. But choosing it simply because it is cheaper or faster can undermine the understanding a company commissioned the research to obtain.
When “fine” does not mean fine
Imagine a patient describing life with a chronic condition.
Asked about treatment, they reply: “It’s fine. You just get on with it.”
An automated interviewer might accept that answer and move on. A skilled moderator might notice hesitation and ask what “getting on with it” involves.
The patient could then describe exhaustion, missed doses or avoiding social occasions.
Without that exploration, a company might conclude that support needs are limited and underinvest in services patients would value.
When probing becomes pressure
Now imagine someone discussing a distressing diagnosis or an embarrassing treatment experience.
An automated system could continue asking for detail because its instructions prioritise completing the discussion guide.
The participant may need reassurance, a pause or the opportunity to stop.
AI can be designed with safeguards. Nevertheless, researchers must assess whether those safeguards and escalation arrangements suit the participants and topic.
A poor experience could cause distress, withdrawals or complaints, while damaging confidence in the research organisation.
When the unexpected matters most
A physician might mention that a minor administrative requirement prevents a treatment from being prescribed.
A rigid interview could record the comment without exploring who controls that requirement or whether it can change.
An experienced moderator can follow that unexpected thread.
Missing it could leave a company investing in promotional messages when the real opportunity involves practical support for treatment access.
What does the saving really cost?
A cheaper interview is poor value if it produces superficial evidence.
The company may need further research, delay decisions or act on an incomplete picture. For agencies, weak interviewing can also damage client trust.
Choose the approach around the conversation
Consider participant vulnerability, topic sensitivity, complexity and the likelihood that unexpected answers will require judgement.
Test automated approaches before deployment, explain AI involvement appropriately and provide clear routes to human support.
Where trust, distress or ambiguity are central, experienced human moderation is essential.
AI can support preparation and administration while people lead the conversation.