Back to Learn
Breakdown · 56

AI and
your health:
where do you draw the line?

You've typed a symptom into ChatGPT at 11pm because your doctor wasn't available. I've done it too. And the answer was... actually pretty useful. But I've also seen where things can go sideways. I wrote this article to be clear about what AI can genuinely offer on health questions, where it gets dangerous, and how you can use it without exposing your most sensitive data.

9 min read Level Beginner Tools ChatGPT, Claude, Gemini
In 30 seconds

What you'll walk away with

A powerful assistant, not a doctor

According to the AI & Health Data Barometer 2025, 45% of French people use AI tools for health questions, with 54% of those using generative AI. That's roughly one in four people. On the professional side, 90% of healthcare workers already use AI tools in their practice, and 53% say it has changed how they work.

These numbers say something simple: AI is already part of the health conversation, whether you want it to be or not. The question is no longer "should I use it?" but "how do I use it without putting myself at risk?"

Because the trap is real. Generative AI is very convincing. It answers with confidence, with detail, with a structure that looks like something a professional would produce. Except it can be wrong, and in health, a mistake can have real consequences for your body or your decisions.

That's not a reason to avoid it. It's a reason to understand what it does well and what it doesn't.

What it actually does well

Generative AI is especially useful for anything that involves understanding and preparation. Here's what I've tested, and what the data backs up.

Making sense of a medical result. Your doctor handed you a blood test full of acronyms you don't recognize. You can ask AI to explain what each marker means, what a normal range looks like, and why a value might be off. It won't tell you whether you're sick. It will give you context so your next conversation with your doctor is more productive.

Preparing for an appointment. You can describe your symptoms, ask what questions to bring to your GP, or have it list the tests typically ordered in that kind of situation. It's a real time-saver, and it puts you in the driver's seat of your own health rather than just along for the ride.

Decoding a package insert or a treatment. Medication leaflets are often unreadable. AI can rewrite them in plain language, explain known interactions between two drugs in broad strokes, or tell you why a medication should be taken on an empty stomach. Keep in mind: this is general information, not a green light for your specific situation.

Finding reliable sources. Ask it to point you toward reference organizations (like the FDA, NIH, or WHO) rather than just trusting its answer alone. A good AI will direct you to verifiable sources instead of asserting everything itself.

How to phrase your question

The more specific your question, the better the answer. Instead of "my back hurts," try "I've had a dull lower back pain for 3 days, no fever, and it eases up when I walk. What are the most common causes?" AI works better with context. If you want to go deeper on how to phrase your requests, I wrote an article on how to write a good prompt when you're not a developer.

One technical thing worth knowing: AI can sometimes "hallucinate," meaning it invents information that sounds plausible but is wrong. In health, that risk is especially serious. I explain this in the site's hallucination glossary entry. And if you want to know how to fact-check what an AI told you, this article on verifying AI-generated information is a good companion read.

The lines you don't cross

There are uses I refuse to hand off to AI, and it's not out of excessive caution. It's because the data is clear on what AI cannot do.

It doesn't diagnose. Even if it gives you a list of conditions that match your symptoms, it doesn't know what your doctor sees when they look at you, listen to your chest, or cross-reference your history with your life story. Clinical decision-making in ambiguous situations, integrating psychosocial context, handling exceptional cases: none of that can be delegated to AI, according to analyses published in April 2026 on the limits of medical AI.

It doesn't handle emergencies. If you have chest pain, signs of a stroke, or a severe allergic reaction: you call emergency services, not ChatGPT. AI has no access to your real-time condition, it can't send help, and every minute counts.

It doesn't deliver a serious diagnosis. Telling someone they have a serious illness is a medical and human act, governed by specific protocols. An AI that told you "you probably have cancer" based on your symptoms wouldn't just be potentially wrong. It would be cutting you off from the human support that moment absolutely requires.

It doesn't replace ongoing care. If you have a chronic condition, an active treatment, or a pregnancy: AI can inform you, but it doesn't track your progress over time, it doesn't adjust a treatment, and it doesn't know your personal tolerance to a medication.

And legally, there's no ambiguity: under European law, medical responsibility for a clinical act remains non-transferable to a human practitioner, even when AI is involved. No tool can shift that responsibility away from you or onto itself.

6 in 10 patients worry about AI dehumanizing their care experience, according to the Talan 2025 study. That number feels right to me. AI is a tool for understanding, not for treating.

The trap to avoid

Looking for confirmation rather than information. If you ask AI a question hoping it'll tell you it's nothing serious, you're biasing the answer from the start. AI responds to what you ask. If you want an honest answer, ask an open question, not a leading one.

Your medical data: what you need to know

This is the topic a lot of people sidestep. And yet it's where some of the most important things happen.

Health data is a special category under GDPR. It gets enhanced protection, and processing it is subject to strict rules. The EU AI Act, in force since August 1, 2024, tightens that framework further by requiring transparency, accountability, and human oversight for systems that handle this kind of data. Starting in August 2026, full obligations will apply to high-risk AI systems, which includes medical devices.

So what does that actually mean for you?

Don't share identifying data in a consumer AI tool. When you describe your symptoms to ChatGPT or Claude, avoid mentioning your name, date of birth, social security number, or your doctor's name. That information isn't needed to get a useful answer, and you don't know exactly how it's stored or used.

Check the terms of use. Major AI platforms have different policies on whether your conversations are used to train their models. Some let you turn that off. Take two minutes to check in the settings.

Stick to generic phrasing. Instead of "I was diagnosed with X in 2023 and I've been on Y ever since," you can ask "what are the known interactions between medication X and medication Y?" You get the same result without exposing your personal file.

Be careful with third-party health apps. Some mobile apps present themselves as AI health assistants. Their privacy terms are sometimes far less protective than those of the major platforms. Before entering sensitive data, check who's behind it, where the data is hosted, and whether the app is GDPR-compliant.

For a deeper dive, I've laid out best practices for protecting your personal data when using AI in this article: personal data and AI. And to understand the European legal framework behind all of this, the article on the AI Act and your business is a good starting point.

One number that stuck with me: according to a 2025 study, only 55% of healthcare workers who use AI say they inform their patients about it, while 84% of French people say they want to be told. That gap says something about the collective maturity we haven't reached yet on this topic.

ChatGPT, Claude, Gemini, Mistral: which one for health?

As of this article, several models are available for consumer use. I'll tell you what I know about each, without claiming one is "the best" for health, because it depends on what you're looking for.

ChatGPT (OpenAI). The ChatGPT-5.6 model, launched June 18, 2026, targets professional use cases with improved capabilities. For health questions, it performs well on rephrasing and plain-language explanations. It tends to add disclaimers, which is actually a good thing in this context.

Claude (Anthropic). Claude Opus 5, released July 24, 2026, is known for its careful phrasing and caution on sensitive topics. I find it especially useful for analyzing a long medical document (an imaging report, lab results) and turning it into a readable summary.

Gemini (Google). Gemini 3.6 Flash has been available since July 21, 2026. It's fast for short, factual questions. Useful if you want a quick answer on a medical term or a definition.

Mistral Large 3. Launched in December 2025 by Mistral AI, this is the French reference model. Its multilingual architecture makes it particularly comfortable with French-language documents, including medical texts.

My takeaway: none of these models are built specifically for health in a clinical sense. They're all useful for understanding and preparing. None of them replace real medical expertise.


FAQ

Can a non-developer entrepreneur use AI for health questions without risk?

Yes, within a well-defined scope. AI is useful for understanding a medical result, preparing for an appointment, or decoding a package insert. The risk shows up when you ask it to diagnose or decide for you. If you keep in mind that you're looking for information and not medical advice, the use is reasonable.

Can AI replace a medical diagnosis or a visit to a healthcare professional?

No. Clinical decision-making, integrating your personal context, physical examination, and the legal responsibility of a medical act all remain exclusively in the hands of a human practitioner. Under European law, that responsibility is non-transferable, even when AI is used as a support tool.

How can I make sure the health information an AI gives me is reliable and up to date?

Ask the AI to cite its sources and point you toward reference organizations (like the FDA, NIH, or WHO). Then verify those sources yourself. AIs can "hallucinate," meaning they produce false information with a confident tone. In health, that verification step is not optional.

What are the legal implications of using AI with my medical data in Europe?

Health data is a sensitive category under GDPR, with enhanced protection. The EU AI Act, in force since August 2024, requires transparency and human oversight for systems that process it. Starting in August 2026, additional obligations will apply to high-risk systems, including medical devices.

Are all AIs trained on ethical, unbiased medical data?

No, and that's a real limitation. General-purpose models are trained on large amounts of web text, which can contain biases, errors, or outdated information. Representation biases (across certain populations, certain conditions) are documented in the literature. That's one more reason not to treat an AI's answer as medical truth.

How do I stop my personal health data from being used without my knowledge by an AI?

A few concrete steps: don't share identifying data (name, date of birth, social security number) in a consumer AI tool. Check the privacy settings of the platform you're using to turn off the use of your conversations for training. Stick to generic phrasing. And before using a third-party health app, verify its GDPR compliance.


My takeaways

AI is a tool for understanding. Not for treating.

I use it to prepare for medical appointments, to make sense of a result I don't understand, to figure out the right questions to ask my doctor. And it does that well. But I never ask it to decide for me, and I never hand over my personal data without thinking it through first.

What I test on myself first, I share here, because the line between "useful information" and "false sense of security" is thin, and it's worth drawing clearly.

AI will keep improving on medical topics. Specialized tools will multiply. But the basic rule won't change: a machine that processes text doesn't replace a human being who looks at you, listens to you, and puts their professional responsibility on the line.

Jérémy Sagnier
Thanks for reading this far 👋

Shall we keep going?

I test AI for real and share what works, without jargon or hype. If this article was useful, the easiest way to stay in the loop is my Friday newsletter. And if you have a question or a doubt: reply to me, I read everything.

Get the newsletter → Read more articles