AI Used a Video of My Fridge to Fix My Diet
I used Google Gemini and Dabarqus, our no-code RAG app from Electric Pipelines to take a video of my fridge and my diet from MyFitnessPal to find recipes that fill holes in my diet with foods I already have. This is how it went:
Gemini
First, I gave Google Gemini two things.
1. A video of my fridge:
2. My diet, pulled from MyFitnessPal:
From there, I asked it to give me a list of foods that would improve my diet (that I already had in my fridge).
Dabarqus & Ollama
With this list in hand, I went to Dabarqus, our no-code RAG app. I stored thousands of recipes from http://recipes.com in a vectorstore, and now I’m prompting for recipes using the ingredients I got from Gemini.
This little command line app just uses Llama 3 via Ollama to present the recipes pulled from the vectorstore in a user-friendly way.
Next, I’d like to integrate some video of my pantry, but I’m glad to see how well this turned out!
Follow Xavier Gray for more cool demos like this.
Recent Posts
-
Using RAG and Ollama to Make a Health Bot
I used RAG to make a medical diagnosis bot that uses med school textbooks to answer questions. These are the 4 steps I took.
-
AI Used a Video of My Fridge to Fix My Diet
I used Google Gemini and Dabarqus, our no-code RAG app to take a video of my fridge and my diet from MyFitnessPal to find recipes that fill holes in my diet with foods I already have. This is how it went.
-
Comparing AI Image Recognition
I compared 3 LLMs on image recognition: GPT-4o, Gemini, and Claude 3.5 Sonnet. I gave each model a picture of my bookshelf and asked them to identify the books. Here’s the results:
-
Using AI for Medical Report Analysis
I used Google Gemini, Langchain and Llama 3 to turn a medical report into an action plan for a patient. I couldn’t believe how good of a job they did, and it only took me one hour. This is how I did it.