Using AI for Medical Report Analysis
I used Google Gemini, Langchain and Llama 3 to turn a medical report into an action plan for a patient. I couldn’t believe how good of a job they did, and it only took me one hour. Here’s how I did it:
Gemini
I started with a picture of a medical report (it’s a sample from Quest Diagnostics, not mine).
I then gave that report to Google Gemini and asked it to evaluate it.
It gave a great rundown of the report. It talked to me like I was a doctor, which was pretty helpful for the next part.
Llama 3
I then asked it for potential risk-factors based on the report and had it summarized everything in one list. I took the summary and used Langchain and Ollama to prompt Llama 3 with it.
This step was pretty important because Gemini and other cloud-based models refuse to give medical advice. They’re worried about pesky things like “liability” and want you to “ask a medical professional.”
But with Llama 3, I could just ask the AI for potential risk factors and course of action.
Results
This did an amazing job!
This is great because it gives you someone to help you with the basics of interpreting health data at your beck and call.
Of course we’d all rather discuss things with medical professionals. But sometimes, I’d like to have some questions answered in seconds rather than days of phone-tag or scheduling.
Follow Xavier Gray on Twitter and LinkedIn for more demos like this!
Recent Posts
-
Using RAG and Ollama to Make a Health Bot
I used RAG to make a medical diagnosis bot that uses med school textbooks to answer questions. These are the 4 steps I took.
-
AI Used a Video of My Fridge to Fix My Diet
I used Google Gemini and Dabarqus, our no-code RAG app to take a video of my fridge and my diet from MyFitnessPal to find recipes that fill holes in my diet with foods I already have. This is how it went.
-
Comparing AI Image Recognition
I compared 3 LLMs on image recognition: GPT-4o, Gemini, and Claude 3.5 Sonnet. I gave each model a picture of my bookshelf and asked them to identify the books. Here’s the results:
-
Using AI for Medical Report Analysis
I used Google Gemini, Langchain and Llama 3 to turn a medical report into an action plan for a patient. I couldn’t believe how good of a job they did, and it only took me one hour. This is how I did it.