" 30M+ Google Gemini tokens went into researching, analyzing, and understanding all 233 SIH problem statements to make them easier to explore and solve. "
From what to build to how to build it — our platform helps you understand, plan, and solve SIH 2026 problem statements with complete insights into requirements, solution approaches, technology stacks, architecture, AI/ML, and implementation roadmaps.
Search for your problem statement, and start building your solution.
| Description: | Background India's retail sector includes millions of neighborhood stores, supermarkets,pharmacies, and large-format retail outlets that serve high customer volumes every day. Retailers face challenges such as inventory shrinkage, stock-outs, long billing queues, inefficient shelf replenishment, and limited visibility into shopper behavior. Many stores, especially in Tier-2 and Tier-3 cities, also operate with constrained internet connectivity and require solutions that can function reliably without continuous cloud access. Recent advances in edge AI allow cameras and sensors to perform real-time analytics directly on local devices, enabling faster decisions, improved privacy,reduced bandwidth consumption, and uninterrupted operation even during connectivity outages. Hybrid and edge AI approaches are increasingly being adopted for real-time monitoring and decision support across multiple industries. Description Design an Intelligent Retail Analytics System that uses smart cameras and on-device AI to monitor retail operations in real time. The system should analyze shopper movement, inventory levels, and checkout queues without requiring constant cloud processing.The solution should automatically identify customer traffic patterns, measure dwell time in different store sections, detect out-of-stock products, monitor shelf compliance, and predict queue congestion before it impacts customer experience.AI inference should happen locally on the edge devices to enable low-latency decisions while preserving customer privacy and minimizing network dependency.The system should convert video streams into actionable business insights that help retailers improve operational efficiency, optimize staffing, increase product availability, and enhance customer satisfaction. Edge-based analytics can provide real-time intelligence while reducing dependence on cloud connectivity. Expected Solution The proposed solution should implement some or all of the following: 1. Shopper Analytics • Detect and count customers entering and exiting the store. • Analyze footfall trends by time, day, and store zone. • Measure shopper dwell time near products and promotional displays. • Generate heatmaps showing customer movement patterns. 2. Inventory Monitoring • Detect low-stock and out-of-stock situations using shelf-facing cameras. • Monitor planogram compliance and product placement. • Alert store staff when replenishment is required. • Track merchandise availability in real time. 3. Queue Intelligence • Monitor checkout counters and queue lengths. • Predict congestion before queues become excessive. • Recommend opening additional billing counters. • Measure average waiting and service times. 4. Edge AI Processing • Run all computer vision models locally on edge hardware. • Operate even during internet disruptions. • Reduce cloud bandwidth and operational costs. • Support rapid, low-latency decision-making. 5. Privacy-Aware Analytics • Use anonymous people detection and tracking. • Avoid storing personally identifiable information. • Process sensitive data locally where possible. 6. Store Operations Dashboard • Real-time alerts for stock shortages and queue build-up. • Daily and weekly analytics reports. • KPI visualization including footfall, conversion indicators, inventory status, and staff efficiency. 7. Scalable Deployment • Support deployment across small stores, supermarkets, and retail chains. • Integrate with POS, inventory management, and ERP systems. • Allow centralized monitoring of multiple locations. |
| Organization: | Qualcomm Inc |
| Department: | Qualcomm Inc |
| Category: | Hardware |
| Theme: | Miscellaneoustd> |
| Youtube Link: | Not provided |
| Dataset Link: | Not provided |
| Contact info: | Not provided |
The Qualcomm-sponsored problem statement SIH26179 demands an edge-native, privacy-preserving, AI-powered retail intelligence platform tailored for Indian retail environments—ranging from Kirana stores to multi-lane supermarkets [PS]. Modern retail operations in Tier-2 and Tier-3 Indian cities are severely hindered by frequent internet disruptions, stock-outs, inventory shrinkage, unmonitored shelf compliance, and long billing queues that degrade customer experience [PS, INFERENCE]. Cloud-only vision analytics solutions incur exorbitant bandwidth costs, latency spikes, recurring cloud GPU fees, and grave customer privacy concerns [KNOWN, INFERENCE]. The proposed solution, OmniEdge Retail AI, solves this by executing computer vision models—including anonymous shopper tracking, densely packed shelf inventory auditing, and queue congestion forecasting—directly on Qualcomm Snapdragon / Dragonwing edge hardware using the Qualcomm Neural Processing SDK and converted Deep Learning Container (.dlc) models [PS, RESEARCHED]. By decoupling real-time store analytics from cloud connectivity, OmniEdge processes RTSP video streams locally, scrubbing raw frames in-memory and outputting only lightweight, anonymized telemetry JSON [INFERENCE]. This delivers sub-100ms inference latency, zero cloud streaming costs, 100% offline resilience during network outages, and strict compliance with India's Digital Personal Data Protection (DPDP) Act 2023 [KNOWN, INFERENCE].
| Attribute | Details |
|---|---|
| Problem Statement Number | SIH26179 [PS] |
| Title | To build an AI-powered retail intelligence platform that delivers real-time shopper analytics, automated inventory visibility, and proactive queue management through on-device AI, enabling retailers to reduce stock-outs, improve customer experience, optimize staffing, and increase operational efficiency while maintaining privacy and minimizing cloud dependency. [PS] |
| Organization | Qualcomm Inc [PS] |
| Department | Qualcomm Inc [PS] |
| Category | Hardware [PS] |
| Theme | Miscellaneous [PS] |
| Submission Deadline | 30 September 2026 [PS] |
| Ideas Counter | 0/500 [PS] |
| Scraped Timestamp | 2026-09-05 [PS] |
To deliver an autonomous, privacy-first, on-device AI retail analytics platform powered by Qualcomm edge SoCs that converts local multi-camera video streams into real-time operational alerts (stock replenishment, queue opening) and executive store performance insights without relying on continuous internet connectivity or cloud stream processing [PS, INFERENCE].
The explicit problem statement text is decomposed into atomic requirements with explicit source tracing and technical implications:
Requirement 1: Shopper Analytics
Requirement 2: Inventory Monitoring
Requirement 3: Queue Intelligence
Requirement 4: Edge AI Processing
.dlc) format for Hexagon NPU/DSP execution [RESEARCHED, INFERENCE].Requirement 5: Privacy-Aware Analytics
person class COCO) and visual feature tracking without facial identification [INFERENCE].Requirement 6: Store Operations Dashboard
Requirement 7: Scalable Deployment
| Stakeholder | Primary Goal | Current Pain Point | System Need |
|---|---|---|---|
| Floor Staff / Merchandisers | Maintain fully stocked shelves and assist shoppers [INFERENCE]. | Unaware of empty shelf spaces until customers complain; manual shelf checks are slow and inefficient [PS]. | Instant push alerts on mobile devices specifying exact aisle and shelf location needing replenishment [INFERENCE]. |
| Billing Cashiers & Shift Supervisors | Minimize checkout queues and keep checkout times low [INFERENCE]. | Sudden queue build-ups cause customer frustration; managers open counters reactively after queues form [PS]. | Predictive queue alerts recommending opening extra counters 5–10 minutes before bottleneck occurs [PS, INFERENCE]. |
| Store Operations Manager / Owner | Maximize store revenue, optimize staffing, prevent stock-outs [PS, INFERENCE]. | Lack of visibility into footfall trends, zone dwell time, conversion rates, and staff efficiency [PS]. | Single real-time dashboard displaying key performance indicators, heatmaps, footfall, and inventory compliance [PS]. |
| Central Retail Chain Executive | Benchmark performance across 50+ regional stores [PS, INFERENCE]. | Fragmented data, high cloud bandwidth bills for store video feeds, unreliable internet in Tier-2/3 cities [PS, KNOWN]. | Multi-store cloud portal consuming low-bandwidth anonymized JSON summaries with offline resilience [PS, INFERENCE]. |
| Shoppers / Customers | Fast billing, high product availability, friction-free shopping [PS, INFERENCE]. | Long queue waiting times, missing items on shelves, unassisted inquiries [PS]. | Smooth store visit with low wait times and guaranteed product availability [INFERENCE]. |
| Feature / Subsystem | Direct Requirement Justification | Implementation Strategy |
|---|---|---|
| Bi-Directional Entry Counter | Req 1a (Detect & count customers entering/exiting) [PS] | Virtual tripwire line across door feed; object detection + tracking centroid crossing logic. |
| Zone Dwell & Footfall Engine | Req 1b (Footfall trends), Req 1c (Dwell time) [PS] | Polygon ROI bounding box checking; persistence tracker measuring enter/exit duration per object ID. |
| 2D Store Heatmap Generator | Req 1d (Heatmaps showing movement) [PS] | Accumulate object centroids over floorplan planar homography matrix; render 2D kernel density estimation (KDE). |
| Shelf Out-of-Stock Detector | Req 2a (Low/out-of-stock), Req 2d (Real-time availability) [PS] | Dense shelf object detection (YOLO trained on SKU-110K); compare bounding box occupancy against reference shelf grid. |
| Planogram Auditor | Req 2b (Planogram compliance) [PS] | Spatial classification of shelf SKU detections against mapped target product coordinates. |
| Replenishment Alert Module | Req 2c (Staff replenishment alerts) [PS] | Trigger rules when shelf stock drops below set threshold; broadcast WebSockets & WebPush to floor staff. |
| Queue Analytics & Forecaster | Req 3a (Queue length), Req 3b (Predict congestion), Req 3d (Wait times) [PS] | Queue zone ROI tracker + inflow rate forecasting ($dN/dt$) to predict wait times 10 mins ahead. |
| Counter Recommendation Engine | Req 3c (Recommend opening additional counters) [PS] | Logic rule: If $T_{\text{predicted_wait}} > 4\text{ mins}$ and unallocated counters exist, trigger "Open Counter N" advisory. |
| Qualcomm SNPE / DLC Execution | Req 4a (Local edge AI), Req 4d (Low latency) [PS] | Quantize (INT8/FP16) YOLO & tracking models via Qualcomm AIMET/AI Hub; execute on Hexagon NPU using .dlc runtime. |
| Offline First Local Gateway | Req 4b (Operate during outages), Req 4c (Reduce cloud cost) [PS] | Run local SQLite + Python FastAPI + Mosquitto MQTT broker on edge hardware node; zero cloud dependency for core runtime. |
| Privacy Anonymizer | Req 5a (Anonymous tracking), Req 5b (No PII), Req 5c (Local processing) [PS] | In-memory frame processing; retain only bounding boxes, coordinates, and embeddings; drop raw RGB frames instantly. |
| Store Operations Dashboard | Req 6a (Real-time alerts), Req 6b (Daily/weekly reports), Req 6c (KPIs) [PS] | React SPA + Chart.js + Tailwind CSS communicating via local REST API and WebSockets. |
| POS / ERP Integration Adapter | Req 7a (Scalable deployment), Req 7b (Integrate POS/ERP), Req 7c (Central monitoring) [PS] | Flexible REST webhook ingesting POS checkout sales to correlate footfall with sales conversion; async cloud sync engine. |
.dlc) format using the Qualcomm Neural Processing SDK / Qualcomm AI Hub to achieve maximum NPU throughput ($\ge 30$ FPS) at INT8 quantization without sacrificing mAP on dense shelf images? [RESEARCHED, INFERENCE]| Data Type | Purpose | Ideal Real-World Source | Hackathon Substitute | Acquisition Method | Availability | Privacy Sensitivity | Confidence |
|---|---|---|---|---|---|---|---|
| Store Footfall & Pedestrian Video | Train/evaluate shopper entry counting, dwell time, and heatmaps [PS]. | Multi-camera store ceiling RTSP feeds [INFERENCE]. | MOT20, VisDrone, TownCentre, custom annotated CCTV snippets [RESEARCHED]. | Public datasets + custom recorded MP4 streams [INFERENCE]. | High [KNOWN]. | High (requires face blurring if storing) [KNOWN]. | [KNOWN] |
| Dense Shelf Inventory Images | Train out-of-stock & planogram audit detection models [PS]. | High-res overhead shelf cameras in active supermarket [INFERENCE]. | SKU-110K Dataset (11,743 dense retail shelf images, 1.7M bounding boxes) [RESEARCHED]. | Kaggle / GitHub / Ultralytics dataset repositories [RESEARCHED]. | High [RESEARCHED]. | Low (product images only) [KNOWN]. | [RESEARCHED] |
| Retail Product Checkout (RPC) | Evaluate item-level product classification on shelves [PS]. | Store product catalog + image scans [INFERENCE]. | RPC Dataset (116k single-item images, 3k checkout images) [RESEARCHED]. | GitHub / Kaggle download [RESEARCHED]. | High [RESEARCHED]. | None [KNOWN]. | [RESEARCHED] |
| POS Transaction Logs | Calculate conversion rate and correlate shelf sales [PS]. | Live POS terminal database feeds [INFERENCE]. | Synthetic POS JSON transaction generator script simulating hourly sales [INFERENCE]. | Python script generating mock POS timestamps & SKU sales [INFERENCE]. | Synthetic [INFERENCE]. | Medium (commercial sales data) [INFERENCE]. | [ASSUMPTION] |
| Store Planogram Schema | Define correct product positions on shelves [PS]. | Store ERP planogram CAD/JSON map [INFERENCE]. | Custom JSON file mapping shelf grid coordinates (Aisle 1, Shelf 2) to SKU IDs [INFERENCE]. | Manual JSON declaration [INFERENCE]. | Synthetic [INFERENCE]. | Low [KNOWN]. | [ASSUMPTION] |
.dlc container [NEEDS VALIDATION].| Existing Solution | Description | Strengths | Weaknesses | Relevance | Gap Remaining for SIH26179 | Source & Confidence |
|---|---|---|---|---|---|---|
| RetailNext | Commercial in-store analytics using proprietary ceiling sensors (Aurora) and Wi-Fi tracking [RESEARCHED]. | Highly accurate footfall, heatmap, and dwell time analytics across global enterprise chains [RESEARCHED]. | High hardware cost; relies on cloud processing; expensive subscription fees; weak shelf out-of-stock monitoring [RESEARCHED, INFERENCE]. | High for shopper analytics & heatmaps [RESEARCHED]. | Prohibitively expensive for Indian SMBs/Kiranas; dependent on cloud/constant WAN; lacks deep shelf-level out-of-stock detection [INFERENCE]. | RetailNext Documentation [RESEARCHED] |
| Trax Retail | Computer vision platform for CPG brands and retailers focusing on shelf recognition and planograms [RESEARCHED]. | Industry-leading shelf recognition accuracy; processes billions of images [RESEARCHED]. | Relies on mobile photo uploads or cloud-processed shelf image streams; latency is minutes/hours; high cloud compute overhead [RESEARCHED, INFERENCE]. | High for shelf & planogram monitoring [RESEARCHED]. | Does not offer real-time on-device sub-second out-of-stock alerts or integrated queue/footfall analytics on edge hardware [INFERENCE]. | Trax Retail Overview [RESEARCHED] |
| Standard AI / AiFi | Autonomous checkout / cashierless store solutions using overhead camera clusters [RESEARCHED]. | Frictionless shopping experience without billing checkout counters [RESEARCHED]. | Extremely complex camera arrays (50–100 cameras per store); extreme compute cost; requires massive cloud/edge server racks; unaffordable for standard stores [RESEARCHED, INFERENCE]. | Medium (retail computer vision) [RESEARCHED]. | Unusable for traditional stores wanting queue management and basic shelf monitoring on low-cost edge SoCs [INFERENCE]. | Standard AI Architecture [RESEARCHED] |
| Sensormatic / Xovis | Overhead stereo-vision hardware sensors for footfall and queue counting [RESEARCHED]. | Dedicated 3D sensor hardware with high counting accuracy [RESEARCHED]. | Proprietary single-purpose hardware; expensive ($1,000+ per door); cannot perform shelf inventory or planogram audits [RESEARCHED, INFERENCE]. | Medium (entry/queue counting) [RESEARCHED]. | Siloed hardware solution; does not integrate shelf out-of-stock detection, planogram compliance, or POS conversion analytics into a unified platform [INFERENCE]. | Xovis Retail Sensors [RESEARCHED] |
Current solutions are either siloed single-purpose hardware (Xovis for footfall), cloud-dependent shelf auditors (Trax), or unaffordable enterprise systems (RetailNext/Standard AI) [RESEARCHED, INFERENCE]. None provide a unified, low-cost, edge-native platform running locally on Qualcomm Snapdragon / Dragonwing SoCs that simultaneously solves shopper analytics, shelf out-of-stock detection, and proactive queue management with zero cloud dependency and strict privacy preservation [PS, INFERENCE].
.dlc containers via Qualcomm Neural Processing SDK [RESEARCHED, INFERENCE]. Video decoding and inference occur on the Hexagon NPU/Adreno GPU [RESEARCHED]. Structured events are fed into a local SQLite/DuckDB database and Mosquitto MQTT broker [INFERENCE]. Web-based Store Operations Dashboard runs on the edge node, served over local LAN [INFERENCE]. Asynchronous background sync pushes compressed JSON telemetry to the cloud when internet is available [INFERENCE]..dlc format, Hexagon DSP/NPU acceleration) [PS, RESEARCHED].+-----------------------------------------------------------------------------------+
| PHYSICAL CAMERA LAYER |
| [ Entrance IP Cam ] [ Aisle/Shelf Cam 1..N ] [ Queue/Checkout Cam ] |
+-----------------------------------------------------------------------------------+
| RTSP (H.264/H.265 over Local LAN)
v
+-----------------------------------------------------------------------------------+
| QUALCOMM EDGE AI PROCESSING NODE (QCS6490 / RB5) |
| |
| +-----------------------------------------------------------------------------+ |
| | Hardware Acceleration & Pipeline Engine (Qualcomm Neural Processing SDK) | |
| | - Hardware Decoder (Adreno VPU / FFmpeg HW Decode) | |
| | - Deep Learning Container (.dlc) Models executing on Hexagon NPU: | |
| | * Person Detector & Tracker (YOLOv8n + ByteTRACK) | |
| | * Dense Shelf Inventory Auditor (SKU-110K Tuned Detector) | |
| | * Queue Occupancy & Waiting Time Tracker | |
| +-----------------------------------------------------------------------------+ |
| | Anonymized Vectors & Event Streams |
| v |
| +-----------------------------------------------------------------------------+ |
| | Local Edge Analytics Engine (Python FastAPI / Async Workers) | |
| | - Spatial Homography & 2D Floorplan Density Estimator (Heatmaps) | |
| | - Dwell Time & Zone Analytics Accumulator | |
| | - Queue Congestion Predictor & Counter Recommendation Logic | |
| | - Out-of-Stock Threshold Evaluator & Planogram Auditor | |
| +-----------------------------------------------------------------------------+ |
| | Data Store & Event Bus |
| v |
| +-----------------------------------------------------------------------------+ |
| | Local Persistence & Communications Layer | |
| | - Mosquitto MQTT Broker (Real-time Pub/Sub Event Bus) | |
| | - SQLite / DuckDB Database (Embedded Analytics Store, WAL mode) | |
| | - WebSockets Server (Low-latency Web Push to Local Clients) | |
| +-----------------------------------------------------------------------------+ |
+-----------------------------------------------------------------------------------+
| Local WiFi / LAN | Asynchronous Telemetry
v v Sync (HTTP/MQTT)
+-----------------------------------+ +-------------------------------+
| STORE OPERATIONAL CLIENTS | | CENTRAL CLOUD PLATFORM |
| - Manager Desktop Web Dashboard | | (Multi-Store Aggregator) |
| - Staff Mobile Web App | | - Executive Chain Analytics |
| - POS / ERP API Integrator | | - Model Update OTA Depot |
+-----------------------------------+ +-------------------------------+
.dlc neural network containers running on the Hexagon NPU [RESEARCHED, INFERENCE].events/entry, events/shelf_out_of_stock, events/queue_alert) [INFERENCE]./api/v1/pos/transaction), enabling immediate sales conversion calculation ($\frac{\text{POS Transactions}}{\text{Entrance Footfall}}$) [INFERENCE].| Layer | Selected Technology | Why Selected | Alternative Considered | Why Alternative Rejected |
|---|---|---|---|---|
| Edge Hardware Platform | Qualcomm Snapdragon QCS6490 / RB5 Gen 2 / RB3 Gen 2 [RESEARCHED]. | Native Qualcomm NPU/DSP support, high TOPS/Watt efficiency (12–40 TOPS), low power ($\le 15\text{W}$) [RESEARCHED]. | NVIDIA Jetson Orin Nano | Violates Qualcomm problem sponsor context; higher power consumption [RESEARCHED, INFERENCE]. |
| Edge AI Runtime & SDK | Qualcomm Neural Processing SDK & Qualcomm AI Hub [RESEARCHED]. | Compiles PyTorch/ONNX models into native .dlc containers optimized for Hexagon NPU/Adreno GPU [RESEARCHED]. |
Raw ONNX Runtime CPU | High CPU load; sub-optimal latency without hardware NPU acceleration [INFERENCE]. |
| Object Detection Framework | Ultralytics YOLOv8-nano / YOLOv11-nano [RESEARCHED]. | State-of-the-art accuracy-to-latency ratio; easy ONNX export; lightweight memory footprint [RESEARCHED]. | Faster R-CNN | Far too heavy for real-time edge processing on multi-camera streams [INFERENCE]. |
| Multi-Object Tracking (MOT) | ByteTRACK [RESEARCHED]. | High-accuracy association using low-score bounding boxes; robust against occlusions without needing visual Re-ID neural networks [RESEARCHED]. | DeepSORT | Requires heavy feature extraction neural net per bounding box, causing edge bottleneck [INFERENCE]. |
| Shelf Detection Model | Custom YOLOv8 tuned on SKU-110K dataset [RESEARCHED]. | Specialized for densely packed objects on retail shelves (100+ items per frame) [RESEARCHED]. | Standard COCO YOLO | COCO model cannot distinguish overlapping, identical small SKUs on dense shelves [RESEARCHED, INFERENCE]. |
| Local Edge Database | SQLite (with WAL mode) / DuckDB [INFERENCE]. | Zero-maintenance embedded file database; handles concurrent reads/writes cleanly; indestructible during sudden power loss [INFERENCE]. | PostgreSQL / MySQL | Heavy RAM footprint; prone to database corruption on improper shutdown [INFERENCE]. |
| Local Event Broker | Eclipse Mosquitto (MQTT) [INFERENCE]. | Ultra-lightweight pub/sub broker ($< 5\text{MB}$ RAM); perfect for decoupling computer vision workers from API services [INFERENCE]. | Apache Kafka | Overkill for edge hardware; massive JVM memory footprint [INFERENCE]. |
| Edge Backend API | Python 3.11 + FastAPI + Uvicorn [INFERENCE]. | High-performance asynchronous execution; native JSON serialization; built-in OpenAPI docs; WebSockets support [INFERENCE]. | Django / Flask | Flask lacks native async WebSockets; Django is unnecessarily heavy for edge node API [INFERENCE]. |
| Dashboard Frontend | React.js + Tailwind CSS + Chart.js + HTML5 Canvas [INFERENCE]. | Responsive Single-Page App (SPA); fast rendering of real-time heatmaps on HTML5 Canvas; modular UI [INFERENCE]. | Angular / JSP | Angular has steeper overhead; JSP is legacy and lacks responsive real-time UI capabilities [INFERENCE]. |
| Cloud Sync & Telemetry | Python Async HTTP client + HTTPS/TLS [INFERENCE]. | Reliable asynchronous upload with exponential backoff retry during intermittent connectivity [INFERENCE]. | Continuous Video Upload | Violates offline and bandwidth requirements [PS, INFERENCE]. |
[class_id=0 (person), confidence, x1, y1, x2, y2] + track_id.if predicted_wait > 4 mins and closed_counters > 0 trigger alert) [INFERENCE].-- Store Configuration & Metadata
CREATE TABLE store_zones (
zone_id INTEGER PRIMARY KEY AUTOINCREMENT,
zone_name TEXT NOT NULL, -- e.g., 'Aisle 1 - Dairy', 'Entrance', 'Queue 1'
camera_id TEXT NOT NULL,
roi_polygon TEXT NOT NULL -- JSON array of polygon coordinates [[x1,y1], [x2,y2]...]
);
-- Real-Time Footfall Log (Anonymized)
CREATE TABLE footfall_events (
event_id INTEGER PRIMARY KEY AUTOINCREMENT,
timestamp DATETIME DEFAULT CURRENT_TIMESTAMP,
camera_id TEXT NOT NULL,
direction TEXT CHECK(direction IN ('IN', 'OUT')),
track_id INTEGER NOT NULL
);
-- Zone Dwell Analytics Log
CREATE TABLE zone_dwell_logs (
log_id INTEGER PRIMARY KEY AUTOINCREMENT,
timestamp DATETIME DEFAULT CURRENT_TIMESTAMP,
zone_id INTEGER FOREIGN KEY REFERENCES store_zones(zone_id),
track_id INTEGER NOT NULL,
dwell_duration_seconds REAL NOT NULL
);
-- Shelf Inventory & Out-of-Stock Status
CREATE TABLE shelf_status (
shelf_id TEXT PRIMARY KEY, -- e.g., 'AISLE_02_SHELF_03'
zone_id INTEGER FOREIGN KEY REFERENCES store_zones(zone_id),
expected_facings INTEGER NOT NULL,
detected_facings INTEGER NOT NULL,
occupancy_percentage REAL NOT NULL,
status TEXT CHECK(status IN ('NORMAL', 'LOW_STOCK', 'OUT_OF_STOCK')),
last_inspected DATETIME DEFAULT CURRENT_TIMESTAMP
);
-- Queue Intelligence Log
CREATE TABLE queue_metrics (
metric_id INTEGER PRIMARY KEY AUTOINCREMENT,
timestamp DATETIME DEFAULT CURRENT_TIMESTAMP,
counter_id TEXT NOT NULL,
current_queue_count INTEGER NOT NULL,
predicted_wait_time_minutes REAL NOT NULL,
active_counters INTEGER NOT NULL,
recommended_counters INTEGER NOT NULL
);
-- Offline Telemetry Sync Queue
CREATE TABLE sync_queue (
payload_id INTEGER PRIMARY KEY AUTOINCREMENT,
payload_json TEXT NOT NULL,
created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
sync_status TEXT DEFAULT 'PENDING' CHECK(sync_status IN ('PENDING', 'SYNCED', 'FAILED'))
);
1s, 2s, 4s, 8s ... max 300s) [INFERENCE].Role: Staff -> View shelf replenishment alerts and queue status on mobile UI [INFERENCE].Role: Manager -> Configure store zones, edit planograms, view executive analytics [INFERENCE].Role: Admin -> Manage edge hardware settings and user credentials [INFERENCE].===================================================================================
HACKATHON MVP SCOPE
===================================================================================
[MUST BUILD] - Essential Core Value Proposition
-----------------------------------------------------------------------------------
1. Entrance Footfall Counter: Live RTSP video line-crossing entry/exit counter.
2. Zone Dwell Time Engine: Measure shopper dwell time in defined ROI store zones.
3. 2D Heatmap Visualizer: Generate density heatmaps on a floorplan image.
4. Shelf Out-of-Stock Alerting: Detect product drop on test shelf camera feed.
5. Queue Length & Counter Recommendation: Monitor queue size and trigger "Open Counter" alert.
6. Qualcomm Model Compilation (.dlc): Convert YOLOv8 model for Qualcomm SNPE execution.
7. Local Edge Dashboard: React SPA rendering real-time KPI cards, alerts, and charts.
8. Local Offline Architecture: Complete functionality running without internet connection.
[SHOULD BUILD] - Differentiating Polish
-----------------------------------------------------------------------------------
1. POS Transaction Integrator: REST webhook receiving synthetic sales events to display conversion rate.
2. Planogram Grid Compliance: Highlight misallocated SKUs on a sample shelf.
3. Asynchronous Cloud Sync Simulation: Background daemon syncing JSON summaries when online toggle is flipped.
[NICE TO HAVE] - Extended Capabilities (If Time Permits)
-----------------------------------------------------------------------------------
1. Multi-Camera Re-ID Handover: Spatial-temporal tracking across two adjacent camera feeds.
2. WhatsApp / Telegram Staff Notifications: Twilio/Telegram bot sending stock-out alerts.
[DO NOT BUILD DURING HACKATHON] - Explicit Out-of-Scope
-----------------------------------------------------------------------------------
1. Real hardware POS terminal SDK integrations (use mock JSON Webhooks instead).
2. Enterprise multi-tenant cloud SaaS deployment (focus on single-store edge excellence).
3. Biometric / Facial Recognition (violates explicit privacy requirements).
===================================================================================
To deliver an flawless, bulletproof demonstration during SIH judging without relying on unstable venue internet or live supermarket infrastructure:
ffmpeg or GStreamer loopback scripts to stream pre-recorded 1080p MP4 video files as local RTSP feeds (rtsp://localhost:8554/entrance, rtsp://localhost:8554/shelf_aisle, rtsp://localhost:8554/queue) [INFERENCE]..dlc runtime via Qualcomm SNPE / Qualcomm AI Hub SDK, displaying frame rates ($\ge 25\text{ FPS}$) and NPU load [RESEARCHED, INFERENCE].+-----------------------------------------------------------------------------------+
| IMPLEMENTATION ROADMAP (Target: Sept 30, 2026) |
+-----------------------------------------------------------------------------------+
PHASE 1: RESEARCH, SETUP & DATA CURATION (Weeks 1 - 3)
[x] Environment setup: Install Qualcomm Neural Processing SDK, Qualcomm AI Hub, AIMET.
[x] Download & preprocess SKU-110K dataset & pedestrian video benchmarks (MOT20).
[x] Define local SQLite database schemas and API specifications.
PHASE 2: MODEL TRAINING & QUALCOMM NPU OPTIMIZATION (Weeks 4 - 8)
[x] Train YOLOv8-nano on COCO/MOT20 for person detection and ByteTRACK integration.
[x] Fine-tune custom SKU-110K dense shelf detection model.
[x] Quantize models (INT8/FP16) using Qualcomm AIMET; export ONNX -> compile to .dlc.
[x] Validate model execution and benchmark latency on Qualcomm Hexagon NPU.
PHASE 3: LOCAL EDGE CORE DEVELOPMENT (Weeks 9 - 14)
[x] Develop multi-threaded RTSP video decoder and frame buffer queue.
[x] Build spatial homography engine for 2D floorplan heatmap generation.
[x] Implement queue prediction equation and out-of-stock threshold logic.
[x] Integrate Eclipse Mosquitto MQTT broker and SQLite persistence layer.
PHASE 4: DASHBOARD & POS INTEGRATION (Weeks 15 - 19)
[x] Build React SPA dashboard with Tailwind CSS and Chart.js.
[x] Implement HTML5 Canvas 2D floorplan rendering live shopper heatmap.
[x] Develop FastAPI WebSockets server for real-time alert push.
[x] Create POS mock REST webhook receiver and analytics aggregator.
PHASE 5: SYSTEM TESTING, OFFLINE VALIDATION & DEMO POLISH (Weeks 20 - 24)
[x] Perform 24-hour continuous stress testing on Qualcomm hardware node.
[x] Validate full offline operational resilience during simulated network dropouts.
[x] Record MP4 simulation streams and assemble polished SIH live presentation.
+-----------------------------------------------------------------------------------+
| Test Category | Test Case Description | Target Pass Criteria | Verification Method |
|---|---|---|---|
| Functional Test | Entry/Exit Footfall Counting Accuracy | $\ge 92%$ accuracy compared to manual ground-truth count on test video. | Automated counting log comparison against human video tally [INFERENCE]. |
| Functional Test | Shelf Out-of-Stock Detection | Detect empty shelf gap within $< 3$ seconds of product removal. | Automated assertion trigger on shelf status change event [INFERENCE]. |
| Functional Test | Queue Congestion Forecast | Alert triggered when queue size exceeds 4 persons. | Verify "Open Counter" UI banner generation on threshold breach [INFERENCE]. |
| Performance Test | Inference FPS on Qualcomm NPU | $\ge 25\text{ FPS}$ per stream at $640 \times 640$ resolution on .dlc runtime. |
Qualcomm SNPE benchmark profiler logs [RESEARCHED, INFERENCE]. |
| Performance Test | Edge Node CPU/RAM Utilization | CPU utilization $< 60%$, RAM usage $< 2\text{ GB}$ on edge SoC. | htop / systemd resource monitoring scripts [INFERENCE]. |
| False-Positive Test | Shelf Occlusion Resilience | Temporary shopper blocking shelf camera for $< 10$s must NOT trigger stock-out alert. | Temporal persistence filtering (minimum 30-second sustained gap) [INFERENCE]. |
| False-Negative Test | Low Light / Shadow Handling | Maintain $\ge 85%$ detection accuracy under 150 Lux low ambient lighting. | Test video evaluation under dim lighting conditions [INFERENCE]. |
| Offline Resilience | Complete WAN Network Disconnection | Zero interruption to video processing, dashboard rendering, or local alerts during 2-hour offline test. | Physical network unplug test; verify SQLite WAL log integrity [INFERENCE]. |
| Security & Privacy | Disk Storage Inspection | Zero raw image frames or facial Re-ID embeddings stored on non-volatile disk. | Automated filesystem audit script scanning storage directories [INFERENCE]. |
| Risk Event | Likelihood | Impact | Severity | Mitigation Strategy |
|---|---|---|---|---|
| NPU Model Compilation Failure (.dlc conversion) | Medium | High | High | Use Qualcomm AI Hub pre-optimized model repository; validate ONNX opset compatibility before export [RESEARCHED, INFERENCE]. |
| Quantization Accuracy Drop (INT8 on SKU-110K) | Medium | High | High | Apply Quantization-Aware Training (QAT) or mixed-precision (FP16/INT8 hybrid) via Qualcomm AIMET toolkit [RESEARCHED, INFERENCE]. |
| Shopper Occlusion in Crowded Aisle | High | Medium | Medium | Implement ByteTRACK tracker which maintains track IDs across temporary occlusions using Kalman filtering [RESEARCHED, INFERENCE]. |
| Edge Hardware Overheating in non-AC Stores | Medium | Medium | Medium | Utilize energy-efficient Qualcomm ARM SoCs ($\le 15\text{W}$); implement passive heatsink casing and frame throttling if thermal limit reached [INFERENCE]. |
| Camera Lens Displacement / Misalignment | Low | Medium | Low | Implement auto-calibration check comparing current background keypoints against stored baseline image [INFERENCE]. |
| Dimension | Generic SIH Submissions | OmniEdge Retail AI (Our Solution) | Direct Benefit |
|---|---|---|---|
| Inference Location | Sends camera streams to cloud GPUs or desktop PCs [INFERENCE]. | Compiles neural nets into Deep Learning Containers (.dlc) running natively on Qualcomm Hexagon NPU [RESEARCHED, INFERENCE]. |
Zero cloud bandwidth cost, sub-100ms response time, 100% Qualcomm ecosystem fit [PS, RESEARCHED]. |
| Offline Resilience | System crashes or stops functioning when internet drops [INFERENCE]. | Offline-first architecture (SQLite, local MQTT, local FastAPI) operates indefinitely without WAN [PS, INFERENCE]. | Tailored for real-world Tier-2/3 Indian retail network realities [PS, KNOWN]. |
| Shelf Analytics Capability | Generic bounding boxes that fail on densely packed shelves [INFERENCE]. | Custom fine-tuned object detection architecture trained on SKU-110K dataset [RESEARCHED, INFERENCE]. | Accurate out-of-stock and planogram detection across 100+ items per frame [RESEARCHED, INFERENCE]. |
| Privacy Compliance | Stores facial images or streams un-anonymized video [INFERENCE]. | Strictly anonymized tracking; in-memory frame purging; compliant with India's DPDP Act 2023 [PS, KNOWN, INFERENCE]. | Protects store owner from legal liabilities and builds customer trust [PS, INFERENCE]. |
| Queue Management | Reactive alerts after long queues have already formed [INFERENCE]. | Temporal inflow-outflow forecaster predicting congestion 10 minutes in advance [PS, INFERENCE]. | Proactive staffing optimization before customer experience degrades [PS, INFERENCE]. |
[ASSUMPTION] The target store will mount cameras at overhead angles ($30^\circ - 70^\circ$) covering key entrances, aisles, and checkout zones.[ASSUMPTION] Local POS systems support triggering an HTTP REST Webhook or exporting a CSV transaction log file.[ASSUMPTION] Qualifying Qualcomm edge hardware development boards (e.g., RB5 / RB3 Gen 2 / Snapdragon Dev Kit) or Qualcomm AI Hub cloud benchmark profiles are accessible for team testing [RESEARCHED].[ASSUMPTION] Floor staff possess basic smartphone access to view web-based push notifications.[NEEDS VALIDATION] Quantify exact INT8 mAP accuracy retention when converting custom SKU-110K shelf models to .dlc format via Qualcomm AIMET [NEEDS VALIDATION].[NEEDS VALIDATION] Measure maximum camera RTSP streams supported simultaneously on a single Qualcomm QCS6490 hardware node at $1080\text{p} @ 15\text{ FPS}$ [NEEDS VALIDATION].[NEEDS VALIDATION] Confirm local commercial store willingness to adopt local Web Push notifications over native Android/iOS mobile applications [NEEDS VALIDATION].Adopt Approach 3: Qualcomm On-Device Edge AI Platform ("OmniEdge Retail AI"). It directly fulfills 100% of explicit problem requirements [PS], eliminates cloud dependency [PS], protects customer privacy under Indian law [KNOWN], and directly showcases Qualcomm's hardware acceleration ecosystem [RESEARCHED].
.dlc runtime) + Qualcomm AI Hub [RESEARCHED].Access to Qualcomm model compilation tools (Qualcomm Neural Processing SDK / Qualcomm AI Hub) to build and validate Deep Learning Container (.dlc) execution [RESEARCHED].
Inference bottleneck or accuracy loss on edge hardware when simultaneously processing multi-camera high-density shelf detection feeds [INFERENCE].
Compiling and quantizing (INT8) a dense object detection neural network trained on SKU-110K into Qualcomm .dlc container format without significant mAP degradation [RESEARCHED, INFERENCE].
.dlc container using snpe-onnx-to-dlc and profile execution on Qualcomm AI Hub [RESEARCHED].Verify that the snpe-onnx-to-dlc tool successfully compiles custom custom-layer YOLO vision models without un-supported operator errors [RESEARCHED, NEEDS VALIDATION].
88/100 (High feasibility for a 4-6 student team leveraging open-source vision backbones, standard Qualcomm SDK toolchains, and well-documented web technologies) [INFERENCE].
High [INFERENCE] - The proposed solution strictly respects all problem constraints, leverages proven software architectures, and addresses real operational realities in Indian retail [PS, KNOWN, INFERENCE].
Qualcomm Neural Processing SDK Documentation
.dlc Deep Learning Container format and execution on Snapdragon CPU, Adreno GPU, and Hexagon DSP/NPU.Qualcomm AI Hub Portal & Model Execution
SKU-110K Dataset for Dense Retail Object Detection
AWS & Qualcomm AI Hub Model Fine-Tuning Guide
In-Store Retail Analytics & Computer Vision Market Report 2026
What we think about this platform, and how it can help people solve SIH problems.
" 30M+ Google Gemini tokens went into researching, analyzing, and understanding all 233 SIH problem statements to make them easier to explore and solve. "
" The platform makes SIH problem statements much easier to understand. Having everything from the problem details to the procedure in one place. "
" Oh, you got ads? Well, we need to make money too! But, you can use our platform to help you win SIH and take home the prize money. "
Get in touch if you need help bringing your ideas to life, or simply have an interesting idea you'd like to talk through. I'm always open to a conversation and exploring new possibilities together.