Cook-Gen: Robust Generative Modeling of Cooking Actions from Recipes

by   Revathy Venkataramanan, et al.

As people become more aware of their food choices, food computation models have become increasingly popular in assisting people in maintaining healthy eating habits. For example, food recommendation systems analyze recipe instructions to assess nutritional contents and provide recipe recommendations. The recent and remarkable successes of generative AI methods, such as auto-regressive large language models, can lead to robust methods for a more comprehensive understanding of recipes for healthy food recommendations beyond surface-level nutrition content assessments. In this study, we explore the use of generative AI methods to extend current food computation models, primarily involving the analysis of nutrition and ingredients, to also incorporate cooking actions (e.g., add salt, fry the meat, boil the vegetables, etc.). Cooking actions are notoriously hard to model using statistical learning methods due to irregular data patterns - significantly varying natural language descriptions for the same action (e.g., marinate the meat vs. marinate the meat and leave overnight) and infrequently occurring patterns (e.g., add salt occurs far more frequently than marinating the meat). The prototypical approach to handling irregular data patterns is to increase the volume of data that the model ingests by orders of magnitude. Unfortunately, in the cooking domain, these problems are further compounded with larger data volumes presenting a unique challenge that is not easily handled by simply scaling up. In this work, we propose novel aggregation-based generative AI methods, Cook-Gen, that reliably generate cooking actions from recipes, despite difficulties with irregular data patterns, while also outperforming Large Language Models and other strong baselines.


Does Journaling Encourage Healthier Choices? Analyzing Healthy Eating Behaviors of Food Journalers

Past research has shown the benefits of food journaling in promoting min...

Semantic Modeling for Food Recommendation Explanations

With the increased use of AI methods to provide recommendations in the h...

Towards Fine-Dining Recipe Generation with Generative Pre-trained Transformers

Food is essential to human survival. So much so that we have developed d...

A Review of the Vision-based Approaches for Dietary Assessment

Dietary-related problems such as obesity are a growing concern in todays...

FIRE: Food Image to REcipe generation

Food computing has emerged as a prominent multidisciplinary field of res...

Eat4Thought: A Design of Food Journaling

Food journaling is an effective method to help people identify their eat...

Context-Aware Drive-thru Recommendation Service at Fast Food Restaurants

Drive-thru is a popular sales channel in the fast food industry where co...

Please sign up or login with your details

Forgot password? Click here to reset