How accurate is AI calorie counting from a photo?

Updated · 10 min read

AI can turn a photo of your meal into a calorie estimate in seconds. Here is how it works, why the numbers can be off, what studies show and how to use them wisely.

Photo calorie counters, including PlateCalories, are handy, but how close are their numbers to what you actually ate? In short: a photo gives a useful estimate, not a measurement. In three 2025 studies, general AI models working from a photo alone had average calorie errors from about 30% to over 70%, depending on the model.

How AI estimates calories from a photo

There are three tasks, done by separate tools or by a single AI model:

  1. Recognizing foods: identifying each food and drink, such as rice, grilled chicken and a glass of milk.
  2. Estimating portions: judging how much of each item there is from visual clues, such as its size compared with the plate or cutlery.
  3. Converting to energy: turning each amount into calories using typical values for that food, then adding up the total.

Errors can creep in at each step and add up. PlateCalories gives all three tasks at once to a single general-purpose AI model, which lists each food with its estimated portion and calories; PlateCalories then adds up these calories to give the total. The model does not weigh food or look up a nutrition database, so its values are typical, not measured.

Which AI models PlateCalories uses

PlateCalories relies mainly on open models, which their makers publish so that others can download and run them: Gemma 4 from Google, GPT-OSS from OpenAI and Llama 4 Scout from Meta. Which service answers depends on the country you connect from, as detected by Cloudflare. PlateCalories uses the free tiers of other AI services first and keeps Cloudflare Workers AI for last. Each request goes to the first service listed below for your region; if that service is busy or unavailable, the next one takes over:

Different models, and even the same model on a second try, can give somewhat different figures, so the same photo will not always get exactly the same result. PlateCalories does not store your photos, voice recordings, descriptions or results, but each AI service has its own rules. For example, Google may use what is sent to the free tier of its Gemini API to improve its products, and human reviewers may read it; requests sent through OpenRouter to its free Gemma model, which Google AI Studio runs, may be kept for up to 55 days. Our privacy policy gives the full details.

The main sources of error

Portion size and depth

A photo is flat. It shows the surface of the food, not its height or what lies underneath, so a thick slice of lasagna or a deep bowl of soup can look smaller than it is. In a 2025 study, some of the largest errors were for dishes served in bowls, possibly because depth is hard to perceive. In the Nutrition5k research project, adding data from a depth sensor cut a model's average calorie error from about 26% to 17–19%. PlateCalories uses an ordinary photo, so it helps to mention a deep bowl or a big serving.

Hidden fats and sugars

Oil, butter, sugar and creamy sauces are often invisible or mixed into food, yet rich in energy. According to USDA FoodData Central, olive oil has 884 kcal per 100 g, or about 119 kcal per tablespoon (13.5 g): two tablespoons in a stir-fry add about 240 kcal that the camera may miss. Our guide to hidden calories gives more examples.

Mixed dishes

In stews, curries, sandwiches and burritos, ingredients are layered or blended, so the AI has to guess what is inside and how much. In another 2025 study, ChatGPT-4o estimated a large serving of lentil curry at 255 g; it actually weighed 480 g.

Lighting, angle and framing

Dim light, strong shadows, filters, extreme angles or a plate cut off at the edge make foods harder to recognize and portions harder to judge. Our food photo tips explain simple fixes.

Unusual or regional dishes

AI models learn from examples, and some cuisines and family recipes may be rare in their training data. In a 2024 study of food-tracking apps, AI image recognition could not identify the separate ingredients of beef pho (a Vietnamese noodle soup) or pearl milk tea. The apps' energy estimates were up to 49% too high for the pho and up to 76% too low for the tea. The authors called for training AI on more mixed dishes and culturally diverse foods.

What research says

Each study tested specific models in specific conditions. None of them tested Gemma 4, the model PlateCalories tries first for meal photos, and PlateCalories itself has not been evaluated in a published study, so its accuracy may be better or worse.

How to use AI calorie estimates wisely

How to add details in PlateCalories

In the PlateCalories calorie counter, you can add details to your photo by typing a description (up to 500 characters) or by speaking for up to 60 seconds. If your browser offers voice typing, its own speech recognition service turns your words into text (Google's in Chrome, Microsoft's in Edge, Apple's in Safari, unless the browser does this on your device), and only that text reaches PlateCalories. If it does not (for example in the built-in browser of the WhatsApp, Instagram or Facebook apps), or if your browser's main language is not English, Spanish or French, your voice is recorded instead, so that the language you speak can be recognized. The recording, like any audio file you choose, is sent once to be transcribed by Whisper, an open speech-recognition model from OpenAI, on Groq (USA) or, as a backup, on Cloudflare Workers AI. The AI then uses your words to correct food names, amounts and hidden ingredients. For example:

Check what was understood: dictated words appear in the description box, where you can correct them, and the transcript of a recording is shown with the result. The result lists each item with its estimated portion and calories. If something is missing or looks wrong, add a correction and analyze again (daily usage limits apply). You can also describe a meal by voice or text, without a photo. The estimate then rests on your words alone, so include amounts when you know them.

When precise tracking matters

Day to day, a rough estimate is often enough. Some situations call for more precision and professional support:

In these cases, ask a doctor or registered dietitian which method suits you, such as weighing your food. Never use an AI estimate to decide a medication dose, such as insulin. If tracking calories makes you anxious or leads you to eat very little, take a break and talk to a health professional. PlateCalories is for adults (18+) and is not medical advice.

Sources