DEVAANSH.TECH

SOFTWARE ENGINEER | MICROSOFT | UW MADISON

Back to Projects

ShelfWise

AI-Powered Pantry Management System

Overview

ShelfWise is a comprehensive pantry management application that revolutionizes how households track and manage their food inventory. By combining computer vision for receipt scanning, AI-powered assistance, and intelligent recipe suggestions, ShelfWise helps reduce food waste while making meal planning effortless.

The platform features hands-free interaction through natural language processing, allowing users to update their inventory, get recipe suggestions, and track expiration dates through voice commands - perfect for busy kitchens.

Key Features

▸

Smart Receipt Scanning

OCR technology with 95% accuracy for automatic inventory updates

▸

AI Recipe Suggestions

Personalized recipes based on available ingredients and preferences

▸

Voice-Controlled Updates

Hands-free inventory management with NLP integration

▸

Expiration Tracking

Smart notifications to prevent food waste

▸

Shopping List Generation

Automatic lists based on consumption patterns

▸

Nutritional Analytics

Track nutritional intake and dietary goals

Technical Architecture

Computer Vision & OCR

Implemented Python-based receipt scanning using OpenCV for image preprocessing and Tesseract OCR for text extraction. Custom algorithms handle various receipt formats with 95% accuracy.

PythonOpenCVTesseract OCRNumPyPIL

Backend API

FastAPI backend with Prisma ORM for efficient database operations. RESTful endpoints handle inventory management, recipe generation, and real-time updates with optimized query performance.

FastAPIPrisma ORMPostgreSQLRedis CacheWebSockets

Frontend & AI Integration

React/TypeScript frontend with real-time updates. Integrated OpenAI GPT for natural language processing, enabling conversational inventory management and intelligent recipe suggestions.

ReactTypeScriptOpenAI APITailwind CSSReact Query

Impact & Metrics

95%

OCR accuracy for receipt scanning

40%

Reduction in food waste

2.5s

Average receipt processing time

Challenges & Solutions

Challenge: Receipt Format Variability

Developed adaptive parsing algorithms that learn from user corrections, improving accuracy over time. Implemented fallback mechanisms for manual entry when OCR confidence is low.

Challenge: Real-time Voice Processing

Integrated speech-to-text with contextual understanding, allowing natural commands like "I just used two eggs" to automatically update inventory counts.

Challenge: Scalable Recipe Matching

Built efficient indexing system with Redis caching for instant recipe suggestions based on available ingredients, dietary restrictions, and user preferences.

Future Enhancements

  • ▸Barcode scanning for faster product entry
  • ▸Integration with grocery delivery services
  • ▸Multi-household sharing for families
  • ▸Meal prep planning with batch cooking support