Problem Statements Analysis

From what to build to how to build it — our platform helps you understand, plan, and solve SIH 2026 problem statements with complete insights into requirements, solution approaches, technology stacks, architecture, AI/ML, and implementation roadmaps.

Scroll down
01 / SIH 2026

PS: SIH26179

To build an AI-powered retail intelligence platform that delivers real-time shopper analytics, automated inventory visibility, and proactive queue management through on-device AI,enabling retailers to reduce stock-outs, improve customer experience, optimize staffing, and increase operational efficiency while maintaining privacy and minimizing cloud dependency.

Description: Background India's retail sector includes millions of neighborhood stores, supermarkets,pharmacies, and large-format retail outlets that serve high customer volumes every day. Retailers face challenges such as inventory shrinkage, stock-outs, long billing queues, inefficient shelf replenishment, and limited visibility into shopper behavior. Many stores, especially in Tier-2 and Tier-3 cities, also operate with constrained internet connectivity and require solutions that can function reliably without continuous cloud access. Recent advances in edge AI allow cameras and sensors to perform real-time analytics directly on local devices, enabling faster decisions, improved privacy,reduced bandwidth consumption, and uninterrupted operation even during connectivity outages. Hybrid and edge AI approaches are increasingly being adopted for real-time monitoring and decision support across multiple industries. Description Design an Intelligent Retail Analytics System that uses smart cameras and on-device AI to monitor retail operations in real time. The system should analyze shopper movement, inventory levels, and checkout queues without requiring constant cloud processing.The solution should automatically identify customer traffic patterns, measure dwell time in different store sections, detect out-of-stock products, monitor shelf compliance, and predict queue congestion before it impacts customer experience.AI inference should happen locally on the edge devices to enable low-latency decisions while preserving customer privacy and minimizing network dependency.The system should convert video streams into actionable business insights that help retailers improve operational efficiency, optimize staffing, increase product availability, and enhance customer satisfaction. Edge-based analytics can provide real-time intelligence while reducing dependence on cloud connectivity. Expected Solution The proposed solution should implement some or all of the following: 1. Shopper Analytics • Detect and count customers entering and exiting the store. • Analyze footfall trends by time, day, and store zone. • Measure shopper dwell time near products and promotional displays. • Generate heatmaps showing customer movement patterns. 2. Inventory Monitoring • Detect low-stock and out-of-stock situations using shelf-facing cameras. • Monitor planogram compliance and product placement. • Alert store staff when replenishment is required. • Track merchandise availability in real time. 3. Queue Intelligence • Monitor checkout counters and queue lengths. • Predict congestion before queues become excessive. • Recommend opening additional billing counters. • Measure average waiting and service times. 4. Edge AI Processing • Run all computer vision models locally on edge hardware. • Operate even during internet disruptions. • Reduce cloud bandwidth and operational costs. • Support rapid, low-latency decision-making. 5. Privacy-Aware Analytics • Use anonymous people detection and tracking. • Avoid storing personally identifiable information. • Process sensitive data locally where possible. 6. Store Operations Dashboard • Real-time alerts for stock shortages and queue build-up. • Daily and weekly analytics reports. • KPI visualization including footfall, conversion indicators, inventory status, and staff efficiency. 7. Scalable Deployment • Support deployment across small stores, supermarkets, and retail chains. • Integrate with POS, inventory management, and ERP systems. • Allow centralized monitoring of multiple locations.
Organization: Qualcomm Inc
Department: Qualcomm Inc
Category: Hardware
Theme: Miscellaneoustd>
Youtube Link: Not provided
Dataset Link: Not provided
Contact info: Not provided

Qualcomm Edge Retail Intelligence Dossier: SIH26179

1. Executive Snapshot

Executive Summary

The Qualcomm-sponsored problem statement SIH26179 demands an edge-native, privacy-preserving, AI-powered retail intelligence platform tailored for Indian retail environments—ranging from Kirana stores to multi-lane supermarkets [PS]. Modern retail operations in Tier-2 and Tier-3 Indian cities are severely hindered by frequent internet disruptions, stock-outs, inventory shrinkage, unmonitored shelf compliance, and long billing queues that degrade customer experience [PS, INFERENCE]. Cloud-only vision analytics solutions incur exorbitant bandwidth costs, latency spikes, recurring cloud GPU fees, and grave customer privacy concerns [KNOWN, INFERENCE]. The proposed solution, OmniEdge Retail AI, solves this by executing computer vision models—including anonymous shopper tracking, densely packed shelf inventory auditing, and queue congestion forecasting—directly on Qualcomm Snapdragon / Dragonwing edge hardware using the Qualcomm Neural Processing SDK and converted Deep Learning Container (.dlc) models [PS, RESEARCHED]. By decoupling real-time store analytics from cloud connectivity, OmniEdge processes RTSP video streams locally, scrubbing raw frames in-memory and outputting only lightweight, anonymized telemetry JSON [INFERENCE]. This delivers sub-100ms inference latency, zero cloud streaming costs, 100% offline resilience during network outages, and strict compliance with India's Digital Personal Data Protection (DPDP) Act 2023 [KNOWN, INFERENCE].

Metadata Table

Attribute Details
Problem Statement Number SIH26179 [PS]
Title To build an AI-powered retail intelligence platform that delivers real-time shopper analytics, automated inventory visibility, and proactive queue management through on-device AI, enabling retailers to reduce stock-outs, improve customer experience, optimize staffing, and increase operational efficiency while maintaining privacy and minimizing cloud dependency. [PS]
Organization Qualcomm Inc [PS]
Department Qualcomm Inc [PS]
Category Hardware [PS]
Theme Miscellaneous [PS]
Submission Deadline 30 September 2026 [PS]
Ideas Counter 0/500 [PS]
Scraped Timestamp 2026-09-05 [PS]

Fundamental System Objective

To deliver an autonomous, privacy-first, on-device AI retail analytics platform powered by Qualcomm edge SoCs that converts local multi-camera video streams into real-time operational alerts (stock replenishment, queue opening) and executive store performance insights without relying on continuous internet connectivity or cloud stream processing [PS, INFERENCE].

2. Problem Deconstruction

The explicit problem statement text is decomposed into atomic requirements with explicit source tracing and technical implications:

  • Requirement 1: Shopper Analytics

    • 1a. Detect and count customers entering and exiting the store [PS].
      • Interpretation: Bi-directional footfall tracking at entrance/exit boundaries.
      • Implementation Implication: Implement cross-line counting algorithm using object detection and multi-object tracking (MOT) on entrance camera streams [INFERENCE].
      • Tag: [PS]
    • 1b. Analyze footfall trends by time, day, and store zone [PS].
      • Interpretation: Aggregate temporal and spatial footfall data into hourly/daily trends across defined store zones.
      • Implementation Implication: Zone polygon mapping overlaid on camera feeds with time-bucketed database aggregation [INFERENCE].
      • Tag: [PS]
    • 1c. Measure shopper dwell time near products and promotional displays [PS].
      • Interpretation: Track individual bounding box duration inside designated region-of-interest (ROI) polygons without identifying the person.
      • Implementation Implication: Associate persistent tracking IDs with ROI bounding boxes and accumulate timestamp deltas [INFERENCE].
      • Tag: [PS]
    • 1d. Generate heatmaps showing customer movement patterns [PS].
      • Interpretation: Aggregate centroid coordinates of shoppers over time into a spatial density visualization on a 2D floorplan.
      • Implementation Implication: Normalize camera perspective transformations onto store floorplans and render Gaussian density heatmaps [INFERENCE].
      • Tag: [PS]
  • Requirement 2: Inventory Monitoring

    • 2a. Detect low-stock and out-of-stock situations using shelf-facing cameras [PS].
      • Interpretation: Continuously or periodically analyze shelf images to identify empty shelf space or missing product facings.
      • Implementation Implication: Execute dense product detection (e.g., SKU-110K architecture) and calculate shelf emptiness ratios against baseline masks [INFERENCE].
      • Tag: [PS]
    • 2b. Monitor planogram compliance and product placement [PS].
      • Interpretation: Compare detected product categories/SKUs against pre-defined target grid coordinates on shelves.
      • Implementation Implication: Grid-cell bounding box matching against store planogram database schemas [INFERENCE].
      • Tag: [PS]
    • 2c. Alert store staff when replenishment is required [PS].
      • Interpretation: Push instant local alerts (web/mobile/audio) when out-of-stock thresholds are breached.
      • Implementation Implication: Real-time notification system via WebSockets, MQTT, or local push notifications [INFERENCE].
      • Tag: [PS]
    • 2d. Track merchandise availability in real time [PS].
      • Interpretation: Maintain a live inventory status map updated whenever shelf changes occur.
      • Implementation Implication: State store in local edge database updated on camera inference passes [INFERENCE].
      • Tag: [PS]
  • Requirement 3: Queue Intelligence

    • 3a. Monitor checkout counters and queue lengths [PS].
      • Interpretation: Detect people standing in defined queue zones and count active billing counters.
      • Implementation Implication: Queue zone polygon bounding box intersection and queue count tracking [INFERENCE].
      • Tag: [PS]
    • 3b. Predict congestion before queues become excessive [PS].
      • Interpretation: Time-series forecasting based on current footfall trends, store entry rates, and checkout throughput speed.
      • Implementation Implication: Lightweight time-series model or heuristic rate equations ($N_{\text{incoming}} - N_{\text{serviced}}$) predicting queue length 5–15 minutes ahead [INFERENCE].
      • Tag: [PS]
    • 3c. Recommend opening additional billing counters [PS].
      • Interpretation: Trigger operational advisories to floor managers when predicted queue time exceeds configured thresholds (e.g., > 3 people or > 4 mins).
      • Implementation Implication: Decision engine generating actionable alerts on manager dashboard and mobile devices [INFERENCE].
      • Tag: [PS]
    • 3d. Measure average waiting and service times [PS].
      • Interpretation: Measure queue entry timestamp to cash register exit timestamp per shopper, and duration at the register.
      • Implementation Implication: Track person trajectory through queue zone into register zone; log service duration deltas [INFERENCE].
      • Tag: [PS]
  • Requirement 4: Edge AI Processing

    • 4a. Run all computer vision models locally on edge hardware [PS].
      • Interpretation: Zero dependency on cloud GPUs for vision inference; inference must run on local SoC (Qualcomm Snapdragon / Dragonwing).
      • Implementation Implication: Convert models (ONNX/PyTorch) into Qualcomm Deep Learning Container (.dlc) format for Hexagon NPU/DSP execution [RESEARCHED, INFERENCE].
      • Tag: [PS]
    • 4b. Operate even during internet disruptions [PS].
      • Interpretation: Full core functionality (analytics, alerts, tracking, dashboards) must persist offline.
      • Implementation Implication: Local edge storage (SQLite/DuckDB), local web server, local MQTT message broker [INFERENCE].
      • Tag: [PS]
    • 4c. Reduce cloud bandwidth and operational costs [PS].
      • Interpretation: No raw video streams uploaded to cloud; only structured metrics/alerts sent during connectivity windows.
      • Implementation Implication: Send light JSON payloads over MQTT/HTTPS when online [INFERENCE].
      • Tag: [PS]
    • 4d. Support rapid, low-latency decision-making [PS].
      • Interpretation: Inference and local alerting cycle completed within milliseconds.
      • Implementation Implication: Optimized model pipeline achieving $\ge 15$ FPS per stream on hardware accelerator [INFERENCE].
      • Tag: [PS]
  • Requirement 5: Privacy-Aware Analytics

    • 5a. Use anonymous people detection and tracking [PS].
      • Interpretation: Detect generic human bodies/bounding boxes/keypoints; no facial recognition or biometric signatures.
      • Implementation Implication: Train models strictly for person detection (person class COCO) and visual feature tracking without facial identification [INFERENCE].
      • Tag: [PS]
    • 5b. Avoid storing personally identifiable information (PII) [PS].
      • Interpretation: No saving of raw camera frames containing human faces, names, or individual biometric profiles.
      • Implementation Implication: Frame buffer processed purely in RAM and immediately overwritten; store only vector trajectories and counts [INFERENCE].
      • Tag: [PS]
    • 5c. Process sensitive data locally where possible [PS].
      • Interpretation: Edge processing isolates all visual data within the physical store perimeter.
      • Implementation Implication: No outbound transmission of video frames under any circumstances [INFERENCE].
      • Tag: [PS]
  • Requirement 6: Store Operations Dashboard

    • 6a. Real-time alerts for stock shortages and queue build-up [PS].
      • Interpretation: Instant UI banners, push notifications, and audible tones when operational thresholds are triggered.
      • Implementation Implication: Responsive Web UI with WebSocket connection to edge node [INFERENCE].
      • Tag: [PS]
    • 6b. Daily and weekly analytics reports [PS].
      • Interpretation: Automated aggregation of sales trends, footfall, dwell time, stock-out frequency, and queue wait times into PDF/CSV/charts.
      • Implementation Implication: Scheduled background jobs aggregating SQLite tables into historical report tables [INFERENCE].
      • Tag: [PS]
    • 6c. KPI visualization including footfall, conversion indicators, inventory status, and staff efficiency [PS].
      • Interpretation: Comprehensive dashboard displaying store health metrics.
      • Implementation Implication: Interactive dashboard components (charts, gauges, heatmaps, live status tables) [INFERENCE].
      • Tag: [PS]
  • Requirement 7: Scalable Deployment

    • 7a. Support deployment across small stores, supermarkets, and retail chains [PS].
      • Interpretation: Modular architecture adaptable from 1-camera Kirana store setup to 16+ camera multi-aisle supermarket.
      • Implementation Implication: Containerized microservices architecture with lightweight resource footprint [INFERENCE].
      • Tag: [PS]
    • 7b. Integrate with POS, inventory management, and ERP systems [PS].
      • Interpretation: Ingest billing transactions and stock ledgers to compute conversion rates and cross-verify physical vs system inventory.
      • Implementation Implication: Modular REST/Webhook API endpoints and SQL connectors for legacy POS/ERP integration [INFERENCE].
      • Tag: [PS]
    • 7c. Allow centralized monitoring of multiple locations [PS].
      • Interpretation: Multi-tenant cloud/central dashboard aggregating store-level metrics from distributed edge devices.
      • Implementation Implication: Asynchronous store-to-cloud telemetry sync engine [INFERENCE].
      • Tag: [PS]

3. Stakeholders & User Needs

Stakeholder Primary Goal Current Pain Point System Need
Floor Staff / Merchandisers Maintain fully stocked shelves and assist shoppers [INFERENCE]. Unaware of empty shelf spaces until customers complain; manual shelf checks are slow and inefficient [PS]. Instant push alerts on mobile devices specifying exact aisle and shelf location needing replenishment [INFERENCE].
Billing Cashiers & Shift Supervisors Minimize checkout queues and keep checkout times low [INFERENCE]. Sudden queue build-ups cause customer frustration; managers open counters reactively after queues form [PS]. Predictive queue alerts recommending opening extra counters 5–10 minutes before bottleneck occurs [PS, INFERENCE].
Store Operations Manager / Owner Maximize store revenue, optimize staffing, prevent stock-outs [PS, INFERENCE]. Lack of visibility into footfall trends, zone dwell time, conversion rates, and staff efficiency [PS]. Single real-time dashboard displaying key performance indicators, heatmaps, footfall, and inventory compliance [PS].
Central Retail Chain Executive Benchmark performance across 50+ regional stores [PS, INFERENCE]. Fragmented data, high cloud bandwidth bills for store video feeds, unreliable internet in Tier-2/3 cities [PS, KNOWN]. Multi-store cloud portal consuming low-bandwidth anonymized JSON summaries with offline resilience [PS, INFERENCE].
Shoppers / Customers Fast billing, high product availability, friction-free shopping [PS, INFERENCE]. Long queue waiting times, missing items on shelves, unassisted inquiries [PS]. Smooth store visit with low wait times and guaranteed product availability [INFERENCE].

4. Requirements Traceability

Feature / Subsystem Direct Requirement Justification Implementation Strategy
Bi-Directional Entry Counter Req 1a (Detect & count customers entering/exiting) [PS] Virtual tripwire line across door feed; object detection + tracking centroid crossing logic.
Zone Dwell & Footfall Engine Req 1b (Footfall trends), Req 1c (Dwell time) [PS] Polygon ROI bounding box checking; persistence tracker measuring enter/exit duration per object ID.
2D Store Heatmap Generator Req 1d (Heatmaps showing movement) [PS] Accumulate object centroids over floorplan planar homography matrix; render 2D kernel density estimation (KDE).
Shelf Out-of-Stock Detector Req 2a (Low/out-of-stock), Req 2d (Real-time availability) [PS] Dense shelf object detection (YOLO trained on SKU-110K); compare bounding box occupancy against reference shelf grid.
Planogram Auditor Req 2b (Planogram compliance) [PS] Spatial classification of shelf SKU detections against mapped target product coordinates.
Replenishment Alert Module Req 2c (Staff replenishment alerts) [PS] Trigger rules when shelf stock drops below set threshold; broadcast WebSockets & WebPush to floor staff.
Queue Analytics & Forecaster Req 3a (Queue length), Req 3b (Predict congestion), Req 3d (Wait times) [PS] Queue zone ROI tracker + inflow rate forecasting ($dN/dt$) to predict wait times 10 mins ahead.
Counter Recommendation Engine Req 3c (Recommend opening additional counters) [PS] Logic rule: If $T_{\text{predicted_wait}} > 4\text{ mins}$ and unallocated counters exist, trigger "Open Counter N" advisory.
Qualcomm SNPE / DLC Execution Req 4a (Local edge AI), Req 4d (Low latency) [PS] Quantize (INT8/FP16) YOLO & tracking models via Qualcomm AIMET/AI Hub; execute on Hexagon NPU using .dlc runtime.
Offline First Local Gateway Req 4b (Operate during outages), Req 4c (Reduce cloud cost) [PS] Run local SQLite + Python FastAPI + Mosquitto MQTT broker on edge hardware node; zero cloud dependency for core runtime.
Privacy Anonymizer Req 5a (Anonymous tracking), Req 5b (No PII), Req 5c (Local processing) [PS] In-memory frame processing; retain only bounding boxes, coordinates, and embeddings; drop raw RGB frames instantly.
Store Operations Dashboard Req 6a (Real-time alerts), Req 6b (Daily/weekly reports), Req 6c (KPIs) [PS] React SPA + Chart.js + Tailwind CSS communicating via local REST API and WebSockets.
POS / ERP Integration Adapter Req 7a (Scalable deployment), Req 7b (Integrate POS/ERP), Req 7c (Central monitoring) [PS] Flexible REST webhook ingesting POS checkout sales to correlate footfall with sales conversion; async cloud sync engine.

5. Constraints & Environment Realities

  1. Network & Connectivity Constraints (Tier-2 / Tier-3 India):
    • Reality: Cellular 4G/5G and local broadband in non-metro Indian commercial districts suffer daily downtime, packet loss, and severe bandwidth throttling [KNOWN, INFERENCE].
    • Design Impact: System MUST NOT stream live camera video to cloud servers [PS, INFERENCE]. All video decoding, AI inference, tracking, aggregation, local storage, and alert generation must happen entirely inside the store LAN [INFERENCE].
  2. Power & Electrical Stability:
    • Reality: Unscheduled power outages and voltage spikes are routine; stores rely on basic inverter/UPS back-ups [KNOWN].
    • Design Impact: Edge hardware must be low-power ($\le 15\text{W} - 30\text{W}$) and run on power-efficient ARM architectures (e.g., Qualcomm QCS6490 / RB5) [RESEARCHED, INFERENCE]. Database engines must use write-ahead logging (WAL) in SQLite/DuckDB to prevent corruption during sudden hard reboots [INFERENCE].
  3. Lighting & Store Physical Conditions:
    • Reality: Kirana and Tier-2 supermarkets frequently mix flickering fluorescent tubes, natural sunlight glare, dim corner aisles, and crowded, narrow passages with hanging promotional flyers [KNOWN, INFERENCE].
    • Design Impact: Vision models must be trained with heavy data augmentation (brightness/contrast jitter, occlusion, shadow synthesis) and robust multi-object tracking (ByteTRACK) resilient to temporary occlusions [INFERENCE].
  4. Hardware & Mounting Limitations:
    • Reality: Retailers will not install expensive ceiling truss systems. Cameras will be mounted on existing walls, light poles, or directly onto shelf headers at angles ranging from $30^\circ$ to $70^\circ$ [INFERENCE].
    • Design Impact: Camera calibration module must support wide-angle distortion correction and homography matrix transformation for accurate floorplan mapping [INFERENCE].
  5. Regulatory & Privacy Laws (India DPDP Act 2023):
    • Reality: Storing identifiable personal video records without explicit user consent violates Indian data privacy laws and creates legal liability [KNOWN].
    • Design Impact: Strict architecture rule: Zero face recognition, zero persistent biological tracking. Video frames must reside in volatile RAM only during inference pass and purged immediately [PS, INFERENCE].

6. Research Questions

  1. Qualcomm Hardware Acceleration: How can custom PyTorch object detection models (e.g., YOLOv8-nano / YOLOv11-nano) be compiled into Qualcomm Deep Learning Container (.dlc) format using the Qualcomm Neural Processing SDK / Qualcomm AI Hub to achieve maximum NPU throughput ($\ge 30$ FPS) at INT8 quantization without sacrificing mAP on dense shelf images? [RESEARCHED, INFERENCE]
  2. Dense Shelf Detection Limits: How well does lightweight edge object detection perform on densely packed shelves (100–300 items per image frame in SKU-110K style scenes) under constrained edge NPU RAM limits? [RESEARCHED, INFERENCE]
  3. Queue Prediction Accuracy: Can a lightweight temporal inflow-outflow differential model predict queue buildup 10 minutes in advance using only entrance footfall velocity and current cashier throughput rates? [INFERENCE]
  4. POS Correlation: How can POS system checkout data be matched with camera-detected queue exit timestamps to measure cashier scanning efficiency without invasive terminal integration? [INFERENCE]
  5. Multi-Camera Tracking Without Face Re-ID: How can anonymous shopper movement be tracked across non-overlapping camera fields of view using spatial-temporal handover logic and appearance embeddings without collecting biometric PII? [INFERENCE]

7. Data Requirements & Sources

Data Type Purpose Ideal Real-World Source Hackathon Substitute Acquisition Method Availability Privacy Sensitivity Confidence
Store Footfall & Pedestrian Video Train/evaluate shopper entry counting, dwell time, and heatmaps [PS]. Multi-camera store ceiling RTSP feeds [INFERENCE]. MOT20, VisDrone, TownCentre, custom annotated CCTV snippets [RESEARCHED]. Public datasets + custom recorded MP4 streams [INFERENCE]. High [KNOWN]. High (requires face blurring if storing) [KNOWN]. [KNOWN]
Dense Shelf Inventory Images Train out-of-stock & planogram audit detection models [PS]. High-res overhead shelf cameras in active supermarket [INFERENCE]. SKU-110K Dataset (11,743 dense retail shelf images, 1.7M bounding boxes) [RESEARCHED]. Kaggle / GitHub / Ultralytics dataset repositories [RESEARCHED]. High [RESEARCHED]. Low (product images only) [KNOWN]. [RESEARCHED]
Retail Product Checkout (RPC) Evaluate item-level product classification on shelves [PS]. Store product catalog + image scans [INFERENCE]. RPC Dataset (116k single-item images, 3k checkout images) [RESEARCHED]. GitHub / Kaggle download [RESEARCHED]. High [RESEARCHED]. None [KNOWN]. [RESEARCHED]
POS Transaction Logs Calculate conversion rate and correlate shelf sales [PS]. Live POS terminal database feeds [INFERENCE]. Synthetic POS JSON transaction generator script simulating hourly sales [INFERENCE]. Python script generating mock POS timestamps & SKU sales [INFERENCE]. Synthetic [INFERENCE]. Medium (commercial sales data) [INFERENCE]. [ASSUMPTION]
Store Planogram Schema Define correct product positions on shelves [PS]. Store ERP planogram CAD/JSON map [INFERENCE]. Custom JSON file mapping shelf grid coordinates (Aisle 1, Shelf 2) to SKU IDs [INFERENCE]. Manual JSON declaration [INFERENCE]. Synthetic [INFERENCE]. Low [KNOWN]. [ASSUMPTION]

Data Categorization Breakdown:

  • A. Explicitly Mentioned Data: Shopper entry/exit counts [PS], footfall trends [PS], dwell times [PS], heatmap coordinates [PS], low-stock/out-of-stock shelf status [PS], queue length & waiting/service times [PS], POS/ERP transaction data [PS].
  • B. Inferred Required Data: Bounding box vector coordinates, multi-object tracking (MOT) trajectory vectors, shelf region-of-interest (ROI) bounding polygons, floorplan homography transformation matrices, camera calibration parameters.
  • C. Data to be Collected: Video streams from test cameras recorded in mock retail environments (hackathon setup).
  • D. Synthetic Data: Mock POS billing transaction stream, simulated planogram grid layouts, multi-store cloud aggregated telemetry streams.
  • E. Data Needing Validation: Exact INT8 accuracy degradation on SKU-110K model when converted to Qualcomm .dlc container [NEEDS VALIDATION].

8. Existing Solutions & Gap Analysis

Existing Solution Description Strengths Weaknesses Relevance Gap Remaining for SIH26179 Source & Confidence
RetailNext Commercial in-store analytics using proprietary ceiling sensors (Aurora) and Wi-Fi tracking [RESEARCHED]. Highly accurate footfall, heatmap, and dwell time analytics across global enterprise chains [RESEARCHED]. High hardware cost; relies on cloud processing; expensive subscription fees; weak shelf out-of-stock monitoring [RESEARCHED, INFERENCE]. High for shopper analytics & heatmaps [RESEARCHED]. Prohibitively expensive for Indian SMBs/Kiranas; dependent on cloud/constant WAN; lacks deep shelf-level out-of-stock detection [INFERENCE]. RetailNext Documentation [RESEARCHED]
Trax Retail Computer vision platform for CPG brands and retailers focusing on shelf recognition and planograms [RESEARCHED]. Industry-leading shelf recognition accuracy; processes billions of images [RESEARCHED]. Relies on mobile photo uploads or cloud-processed shelf image streams; latency is minutes/hours; high cloud compute overhead [RESEARCHED, INFERENCE]. High for shelf & planogram monitoring [RESEARCHED]. Does not offer real-time on-device sub-second out-of-stock alerts or integrated queue/footfall analytics on edge hardware [INFERENCE]. Trax Retail Overview [RESEARCHED]
Standard AI / AiFi Autonomous checkout / cashierless store solutions using overhead camera clusters [RESEARCHED]. Frictionless shopping experience without billing checkout counters [RESEARCHED]. Extremely complex camera arrays (50–100 cameras per store); extreme compute cost; requires massive cloud/edge server racks; unaffordable for standard stores [RESEARCHED, INFERENCE]. Medium (retail computer vision) [RESEARCHED]. Unusable for traditional stores wanting queue management and basic shelf monitoring on low-cost edge SoCs [INFERENCE]. Standard AI Architecture [RESEARCHED]
Sensormatic / Xovis Overhead stereo-vision hardware sensors for footfall and queue counting [RESEARCHED]. Dedicated 3D sensor hardware with high counting accuracy [RESEARCHED]. Proprietary single-purpose hardware; expensive ($1,000+ per door); cannot perform shelf inventory or planogram audits [RESEARCHED, INFERENCE]. Medium (entry/queue counting) [RESEARCHED]. Siloed hardware solution; does not integrate shelf out-of-stock detection, planogram compliance, or POS conversion analytics into a unified platform [INFERENCE]. Xovis Retail Sensors [RESEARCHED]

The Winning Gap Summary:

Current solutions are either siloed single-purpose hardware (Xovis for footfall), cloud-dependent shelf auditors (Trax), or unaffordable enterprise systems (RetailNext/Standard AI) [RESEARCHED, INFERENCE]. None provide a unified, low-cost, edge-native platform running locally on Qualcomm Snapdragon / Dragonwing SoCs that simultaneously solves shopper analytics, shelf out-of-stock detection, and proactive queue management with zero cloud dependency and strict privacy preservation [PS, INFERENCE].

9. Candidate Solution Approaches

Approach 1: Cloud-Centric Video Streaming Platform (AWS / GCP Vision AI)

  • Mechanism: IP Cameras stream raw RTSP video over internet (H.264/H.265) to AWS Kinesis Video Streams; AWS Rekognition and cloud EC2 GPU instances run heavy object detection and tracking [INFERENCE].
  • Evaluation:
    • Problem Fit: Poor. Fails requirement 4a, 4b, 4c, 5c [PS].
    • Accuracy Potential: Very High (unconstrained cloud GPU resources) [INFERENCE].
    • Data Requirements: Continuous broadband video upload bandwidth ($\approx 4\text{ Mbps}$ per camera) [INFERENCE].
    • Complexity: Low edge complexity; High cloud infrastructure management [INFERENCE].
    • Cost: Prohibitively high (cloud video ingestion, bandwidth, and hourly GPU compute costs) [INFERENCE].
    • Feasibility: Fails Tier-2/3 Indian retail network realities [PS, INFERENCE].
    • Risks: Complete system outage during internet disconnects; high recurring operating cost [INFERENCE].

Approach 2: Heavy Edge Server PC with Discrete Desktop GPU (x86 + NVIDIA RTX)

  • Mechanism: On-premise industrial PC equipped with NVIDIA RTX GPU running DeepStream SDK and Docker containers [INFERENCE].
  • Evaluation:
    • Problem Fit: Partial. Satisfies local inference, but violates hardware cost, power efficiency, and Qualcomm edge SoC focus [PS, INFERENCE].
    • Accuracy Potential: High [INFERENCE].
    • Data Requirements: Local RTSP streams over Gigabit Ethernet [INFERENCE].
    • Complexity: High power ($250\text{W} - 500\text{W}$), active cooling fan noise, expensive hardware ($$1,500 - $3,000$) [INFERENCE].
    • Feasibility: Unrealistic for small Kirana stores and SMB supermarkets [INFERENCE].
    • Risks: Thermal failure in non-air-conditioned stores; high capital cost [INFERENCE].

Approach 3 (PROPOSED): Qualcomm On-Device Edge AI Platform ("OmniEdge Retail AI")

  • Mechanism: Local Qualcomm Snapdragon / Dragonwing Edge SoC (e.g., QCS6490 / RB5 Gen 2 / RB3 Gen 2) running optimized computer vision pipelines compiled into .dlc containers via Qualcomm Neural Processing SDK [RESEARCHED, INFERENCE]. Video decoding and inference occur on the Hexagon NPU/Adreno GPU [RESEARCHED]. Structured events are fed into a local SQLite/DuckDB database and Mosquitto MQTT broker [INFERENCE]. Web-based Store Operations Dashboard runs on the edge node, served over local LAN [INFERENCE]. Asynchronous background sync pushes compressed JSON telemetry to the cloud when internet is available [INFERENCE].
  • Evaluation:
    • Problem Fit: Perfect. Satisfies 100% of explicit requirements 1–7 [PS, INFERENCE].
    • Accuracy Potential: High (optimized INT8/FP16 models via AIMET/AI Hub) [RESEARCHED, INFERENCE].
    • Data Requirements: Local camera RTSP feeds; minimal outbound WAN bandwidth ($< 1\text{MB}$ per day of JSON telemetry) [INFERENCE].
    • Complexity: Medium (model compilation and quantization workflow via Qualcomm AI Hub) [RESEARCHED, INFERENCE].
    • Cost: Low power ($10\text{W} - 25\text{W}$), low hardware cost ($$150 - $400$ per node) [RESEARCHED, INFERENCE].
    • Feasibility: Ideal for 4-6 student team hackathon project with real Qualcomm ecosystem alignment [INFERENCE].
    • Risks: Quantization accuracy loss on dense shelf detection (mitigated by fine-tuning with AIMET) [RESEARCHED, INFERENCE].

10. Recommended Approach & Why

Selection: Approach 3 (Qualcomm On-Device Edge AI Platform)

Why Alternatives Were Rejected:

  1. Approach 1 (Cloud-Centric): Directly violates explicit requirement 4a ("Run all computer vision models locally on edge hardware") and requirement 4b ("Operate even during internet disruptions") [PS]. It introduces unsustainable monthly cloud bills and violates privacy requirement 5c [PS, INFERENCE].
  2. Approach 2 (Heavy x86 GPU Server): Fails the economic and environmental constraints of Indian retail stores (high power consumption, active fan maintenance in dusty environments, high upfront cost) and fails to leverage Qualcomm hardware—the sponsoring organization [PS, RESEARCHED, INFERENCE].

Why Approach 3 Wins:

  • 100% Problem Alignment: Built precisely around Qualcomm's edge AI stack (Qualcomm Neural Processing SDK, Deep Learning Container .dlc format, Hexagon DSP/NPU acceleration) [PS, RESEARCHED].
  • Zero WAN Dependency: Runs entirely offline inside the store LAN. Network outages do not stop real-time queue alerts or shelf stock notifications [PS, INFERENCE].
  • Privacy by Design: Raw video frames are decoded into RAM, processed by the NPU, and immediately dropped [PS, INFERENCE]. Only numerical bounding coordinates and anonymous tracking IDs persist [INFERENCE].
  • Economic Viability: Low power consumption ($\le 15\text{W}$) allows running on store inverter backup power during load shedding [KNOWN, INFERENCE].

11. Technical Architecture

Layered System Architecture Diagram

+-----------------------------------------------------------------------------------+
|                            PHYSICAL CAMERA LAYER                                  |
|   [ Entrance IP Cam ]     [ Aisle/Shelf Cam 1..N ]     [ Queue/Checkout Cam ]     |
+-----------------------------------------------------------------------------------+
                                         | RTSP (H.264/H.265 over Local LAN)
                                         v
+-----------------------------------------------------------------------------------+
|                  QUALCOMM EDGE AI PROCESSING NODE (QCS6490 / RB5)                 |
|                                                                                   |
|  +-----------------------------------------------------------------------------+  |
|  | Hardware Acceleration & Pipeline Engine (Qualcomm Neural Processing SDK)   |  |
|  |  - Hardware Decoder (Adreno VPU / FFmpeg HW Decode)                        |  |
|  |  - Deep Learning Container (.dlc) Models executing on Hexagon NPU:          |  |
|  |     * Person Detector & Tracker (YOLOv8n + ByteTRACK)                      |  |
|  |     * Dense Shelf Inventory Auditor (SKU-110K Tuned Detector)              |  |
|  |     * Queue Occupancy & Waiting Time Tracker                               |  |
|  +-----------------------------------------------------------------------------+  |
|                                         | Anonymized Vectors & Event Streams      |
|                                         v                                         |
|  +-----------------------------------------------------------------------------+  |
|  | Local Edge Analytics Engine (Python FastAPI / Async Workers)                |  |
|  |  - Spatial Homography & 2D Floorplan Density Estimator (Heatmaps)          |  |
|  |  - Dwell Time & Zone Analytics Accumulator                                  |  |
|  |  - Queue Congestion Predictor & Counter Recommendation Logic               |  |
|  |  - Out-of-Stock Threshold Evaluator & Planogram Auditor                      |  |
|  +-----------------------------------------------------------------------------+  |
|                                         | Data Store & Event Bus                  |
|                                         v                                         |
|  +-----------------------------------------------------------------------------+  |
|  | Local Persistence & Communications Layer                                   |  |
|  |  - Mosquitto MQTT Broker (Real-time Pub/Sub Event Bus)                      |  |
|  |  - SQLite / DuckDB Database (Embedded Analytics Store, WAL mode)             |  |
|  |  - WebSockets Server (Low-latency Web Push to Local Clients)                 |  |
|  +-----------------------------------------------------------------------------+  |
+-----------------------------------------------------------------------------------+
        | Local WiFi / LAN                                      | Asynchronous Telemetry
        v                                                       v Sync (HTTP/MQTT)
+-----------------------------------+               +-------------------------------+
|  STORE OPERATIONAL CLIENTS        |               | CENTRAL CLOUD PLATFORM        |
|  - Manager Desktop Web Dashboard  |               | (Multi-Store Aggregator)      |
|  - Staff Mobile Web App           |               | - Executive Chain Analytics   |
|  - POS / ERP API Integrator       |               | - Model Update OTA Depot      |
+-----------------------------------+               +-------------------------------+

Data Flow Narrative

  1. Ingestion: Multiple IP cameras stream H.264/H.265 RTSP feeds over the store's local Wi-Fi/Ethernet network to the Qualcomm Edge AI Node [INFERENCE].
  2. Inference & Anonymization: The edge node decodes video streams in RAM [INFERENCE]. The Qualcomm Neural Processing SDK passes frame tensors directly into converted .dlc neural network containers running on the Hexagon NPU [RESEARCHED, INFERENCE].
    • Entrance Camera: YOLOv8n detects human bounding boxes; ByteTRACK assigns temporary IDs to calculate entry/exit line crossings [INFERENCE].
    • Aisle Cameras: YOLOv8n tracks shopper centroids inside designated ROI polygons to compute zone dwell time [INFERENCE]. Coordinates are projected onto a 2D floorplan via homography matrix multiplication to generate movement heatmaps [INFERENCE].
    • Shelf Cameras: Dense object detector inspects shelf bounding boxes against reference planogram masks to flag empty gaps (out-of-stock) [INFERENCE].
    • Queue Camera: Person tracking inside queue ROI polygons calculates queue length, service duration, and forecasts congestion 10 minutes ahead [INFERENCE].
    • Frame Purging: Video frames are instantly overwritten in volatile RAM after inference pass. Zero video is saved to disk [PS, INFERENCE].
  3. Local Event Processing: Inferred coordinates and detection events are published to the local Mosquitto MQTT broker (events/entry, events/shelf_out_of_stock, events/queue_alert) [INFERENCE].
  4. Local Storage & Alerting: The FastAPI edge service subscribes to MQTT topics, updates local SQLite tables, and pushes real-time WebSocket alerts to floor staff mobile apps and store manager dashboards [INFERENCE].
  5. POS Integration: When a cashier scans items at POS, the transaction total and SKU count are posted to the local edge REST API (/api/v1/pos/transaction), enabling immediate sales conversion calculation ($\frac{\text{POS Transactions}}{\text{Entrance Footfall}}$) [INFERENCE].
  6. Cloud Sync: When internet connectivity is online, a background daemon uploads compressed daily JSON metrics to the central cloud platform for multi-store benchmarking [INFERENCE].

12. Technology Stack

Layer Selected Technology Why Selected Alternative Considered Why Alternative Rejected
Edge Hardware Platform Qualcomm Snapdragon QCS6490 / RB5 Gen 2 / RB3 Gen 2 [RESEARCHED]. Native Qualcomm NPU/DSP support, high TOPS/Watt efficiency (12–40 TOPS), low power ($\le 15\text{W}$) [RESEARCHED]. NVIDIA Jetson Orin Nano Violates Qualcomm problem sponsor context; higher power consumption [RESEARCHED, INFERENCE].
Edge AI Runtime & SDK Qualcomm Neural Processing SDK & Qualcomm AI Hub [RESEARCHED]. Compiles PyTorch/ONNX models into native .dlc containers optimized for Hexagon NPU/Adreno GPU [RESEARCHED]. Raw ONNX Runtime CPU High CPU load; sub-optimal latency without hardware NPU acceleration [INFERENCE].
Object Detection Framework Ultralytics YOLOv8-nano / YOLOv11-nano [RESEARCHED]. State-of-the-art accuracy-to-latency ratio; easy ONNX export; lightweight memory footprint [RESEARCHED]. Faster R-CNN Far too heavy for real-time edge processing on multi-camera streams [INFERENCE].
Multi-Object Tracking (MOT) ByteTRACK [RESEARCHED]. High-accuracy association using low-score bounding boxes; robust against occlusions without needing visual Re-ID neural networks [RESEARCHED]. DeepSORT Requires heavy feature extraction neural net per bounding box, causing edge bottleneck [INFERENCE].
Shelf Detection Model Custom YOLOv8 tuned on SKU-110K dataset [RESEARCHED]. Specialized for densely packed objects on retail shelves (100+ items per frame) [RESEARCHED]. Standard COCO YOLO COCO model cannot distinguish overlapping, identical small SKUs on dense shelves [RESEARCHED, INFERENCE].
Local Edge Database SQLite (with WAL mode) / DuckDB [INFERENCE]. Zero-maintenance embedded file database; handles concurrent reads/writes cleanly; indestructible during sudden power loss [INFERENCE]. PostgreSQL / MySQL Heavy RAM footprint; prone to database corruption on improper shutdown [INFERENCE].
Local Event Broker Eclipse Mosquitto (MQTT) [INFERENCE]. Ultra-lightweight pub/sub broker ($< 5\text{MB}$ RAM); perfect for decoupling computer vision workers from API services [INFERENCE]. Apache Kafka Overkill for edge hardware; massive JVM memory footprint [INFERENCE].
Edge Backend API Python 3.11 + FastAPI + Uvicorn [INFERENCE]. High-performance asynchronous execution; native JSON serialization; built-in OpenAPI docs; WebSockets support [INFERENCE]. Django / Flask Flask lacks native async WebSockets; Django is unnecessarily heavy for edge node API [INFERENCE].
Dashboard Frontend React.js + Tailwind CSS + Chart.js + HTML5 Canvas [INFERENCE]. Responsive Single-Page App (SPA); fast rendering of real-time heatmaps on HTML5 Canvas; modular UI [INFERENCE]. Angular / JSP Angular has steeper overhead; JSP is legacy and lacks responsive real-time UI capabilities [INFERENCE].
Cloud Sync & Telemetry Python Async HTTP client + HTTPS/TLS [INFERENCE]. Reliable asynchronous upload with exponential backoff retry during intermittent connectivity [INFERENCE]. Continuous Video Upload Violates offline and bandwidth requirements [PS, INFERENCE].

13. AI/ML Justification

1. Anonymous Shopper Detection & Footfall Tracking

  • Purpose: Detect customers, count store entries/exits, track dwell time, and generate movement heatmaps [PS].
  • Model Type: YOLOv8-nano (Object Detection) + ByteTRACK (Heuristic Multi-Object Tracker) [RESEARCHED].
  • Input: 1080p RTSP camera frame (30 FPS, resized to $640 \times 640$).
  • Output: List of bounding boxes: [class_id=0 (person), confidence, x1, y1, x2, y2] + track_id.
  • Data Required: COCO dataset + VisDrone / MOT20 fine-tuning [RESEARCHED].
  • Why AI is Necessary: Traditional infrared break-beams cannot measure dwell time, movement vectors, or zone heatmaps [INFERENCE]. Rule-based blob detection fails under crowding [INFERENCE].
  • Evaluation: Mean Average Precision (mAP@50 $\ge 85%$), Multiple Object Tracking Accuracy (MOTA $\ge 75%$) [INFERENCE].
  • Failure Mode: Severe camera occlusion or extreme low light.
  • Human Oversight: None required for automated counting; aggregated metrics displayed on dashboard [INFERENCE].

2. Dense Shelf Inventory & Out-of-Stock Detector

  • Purpose: Identify empty shelf gaps, count product facings, and detect planogram compliance errors [PS].
  • Model Type: Custom YOLOv8 Medium/Nano trained on SKU-110K dataset [RESEARCHED].
  • Input: High-resolution shelf crop image ($1280 \times 1280$) taken every 60 seconds [INFERENCE].
  • Output: Grid array of detected SKU bounding boxes + Occupancy Ratio per shelf zone [INFERENCE].
  • Data Required: SKU-110K dataset (11,743 images, 1.7M bounding boxes) + store planogram target map [RESEARCHED].
  • Why AI is Necessary: Rule-based color/edge detection fails due to changing product packaging, shadows, and packaging updates [INFERENCE].
  • Evaluation: Precision/Recall on dense object bounding boxes (mAP@50 $\ge 80%$) [INFERENCE].
  • Failure Mode: False positive out-of-stock alert if a shopper temporarily blocks the camera view.
  • Human Oversight: Alerts push a visual crop of the shelf zone to floor staff mobile app; staff physically verifies before restocking [INFERENCE].

3. Queue Length & Congestion Forecaster

  • Purpose: Count shoppers in queue zone and predict queue wait time 10 minutes ahead [PS].
  • Model Type: Hybrid AI-Heuristic Model: Person detection ROI count + Differential Inflow-Outflow Time-Series Equation [INFERENCE].
  • Input: Current queue count $N(t)$, entry footfall velocity $\frac{dE}{dt}$, historical average checkout rate $S$ (seconds per customer) [INFERENCE].
  • Output: Predicted queue length $N(t+10\text{min})$ and predicted wait time $T_{\text{wait}}$ [INFERENCE].
  • Data Required: Historical queue length logs and POS transaction time stamps [INFERENCE].
  • Why AI is Necessary: Simple static thresholding triggers alerts after the line is long; predictive modeling triggers alerts before congestion occurs [PS, INFERENCE].
  • Evaluation: Mean Absolute Error (MAE) $< 1.5$ persons on 10-minute horizon forecast [INFERENCE].
  • Failure Mode: Unexpected cashier shift change or terminal freeze causes forecast lag.
  • Human Oversight: Store manager receives "Open Counter 3" recommendation and makes final decision to deploy staff [PS, INFERENCE].

Explicit Non-AI Directives:

  • DO NOT USE AI FOR:
    1. Counter Recommendation Logic: Standard deterministic threshold rules (if predicted_wait > 4 mins and closed_counters > 0 trigger alert) [INFERENCE].
    2. POS Sales Conversion: Pure arithmetic division ($\frac{\text{Sales Count}}{\text{Footfall Count}}$) [INFERENCE].
    3. Planogram Layout Storage: Static JSON database mapping [INFERENCE].

14. Data Architecture & Offline/Low-Network Design

Local SQLite Database Schema

-- Store Configuration & Metadata
CREATE TABLE store_zones (
    zone_id INTEGER PRIMARY KEY AUTOINCREMENT,
    zone_name TEXT NOT NULL, -- e.g., 'Aisle 1 - Dairy', 'Entrance', 'Queue 1'
    camera_id TEXT NOT NULL,
    roi_polygon TEXT NOT NULL -- JSON array of polygon coordinates [[x1,y1], [x2,y2]...]
);

-- Real-Time Footfall Log (Anonymized)
CREATE TABLE footfall_events (
    event_id INTEGER PRIMARY KEY AUTOINCREMENT,
    timestamp DATETIME DEFAULT CURRENT_TIMESTAMP,
    camera_id TEXT NOT NULL,
    direction TEXT CHECK(direction IN ('IN', 'OUT')),
    track_id INTEGER NOT NULL
);

-- Zone Dwell Analytics Log
CREATE TABLE zone_dwell_logs (
    log_id INTEGER PRIMARY KEY AUTOINCREMENT,
    timestamp DATETIME DEFAULT CURRENT_TIMESTAMP,
    zone_id INTEGER FOREIGN KEY REFERENCES store_zones(zone_id),
    track_id INTEGER NOT NULL,
    dwell_duration_seconds REAL NOT NULL
);

-- Shelf Inventory & Out-of-Stock Status
CREATE TABLE shelf_status (
    shelf_id TEXT PRIMARY KEY, -- e.g., 'AISLE_02_SHELF_03'
    zone_id INTEGER FOREIGN KEY REFERENCES store_zones(zone_id),
    expected_facings INTEGER NOT NULL,
    detected_facings INTEGER NOT NULL,
    occupancy_percentage REAL NOT NULL,
    status TEXT CHECK(status IN ('NORMAL', 'LOW_STOCK', 'OUT_OF_STOCK')),
    last_inspected DATETIME DEFAULT CURRENT_TIMESTAMP
);

-- Queue Intelligence Log
CREATE TABLE queue_metrics (
    metric_id INTEGER PRIMARY KEY AUTOINCREMENT,
    timestamp DATETIME DEFAULT CURRENT_TIMESTAMP,
    counter_id TEXT NOT NULL,
    current_queue_count INTEGER NOT NULL,
    predicted_wait_time_minutes REAL NOT NULL,
    active_counters INTEGER NOT NULL,
    recommended_counters INTEGER NOT NULL
);

-- Offline Telemetry Sync Queue
CREATE TABLE sync_queue (
    payload_id INTEGER PRIMARY KEY AUTOINCREMENT,
    payload_json TEXT NOT NULL,
    created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
    sync_status TEXT DEFAULT 'PENDING' CHECK(sync_status IN ('PENDING', 'SYNCED', 'FAILED'))
);

Synchronization & Low-Network Strategy

  • Local Caching: All analytics events are written directly to the local SQLite database running in Write-Ahead Logging (WAL) mode, guaranteeing zero data loss during network outages [INFERENCE].
  • Payload Compression: Every hour, a background sync service aggregates atomic events into compressed JSON summaries (e.g., hourly footfall histogram, shelf out-of-stock events) [INFERENCE]. Payload size is typically $< 50\text{ KB}$ per store/day [INFERENCE].
  • Retry & Backoff: When internet connectivity is restored, the sync manager sends queued payloads to the cloud endpoint using an exponential backoff algorithm (1s, 2s, 4s, 8s ... max 300s) [INFERENCE].
  • Conflict Handling: The edge database is the single source of truth for real-time operational state and store metrics [INFERENCE]. Cloud serves purely as a read-only historical reporting portal [INFERENCE].
  • Bandwidth Reduction: Raw video is never transmitted over the WAN [PS]. Bandwidth consumption drops from gigabytes/hour to kilobytes/day [INFERENCE].

15. Security, Privacy & Governance

  • Personal Personal Data Protection (DPDP Act 2023 Compliance):
    • No Facial Recognition: The system explicitly excludes facial feature extraction networks [PS]. Person detection uses generic silhouette bounding boxes [INFERENCE].
    • In-Memory Processing: Video frames reside in volatile GPU/NPU RAM buffers during the single inference execution cycle ($\approx 15\text{ms}$) and are immediately overwritten by subsequent frames [PS, INFERENCE].
    • Zero Visual Record: No video files, images, or identifiable facial stills are ever written to non-volatile disk storage during normal operational monitoring [PS, INFERENCE].
  • Location Data & Store Perimeter Isolation:
    • Camera feeds operate entirely on an isolated physical LAN subnet with no port forwarding to the external internet [INFERENCE].
  • Authentication & Access Control:
    • Edge Dashboard access requires OAuth2 / JWT authentication with Role-Based Access Control (RBAC):
      • Role: Staff -> View shelf replenishment alerts and queue status on mobile UI [INFERENCE].
      • Role: Manager -> Configure store zones, edit planograms, view executive analytics [INFERENCE].
      • Role: Admin -> Manage edge hardware settings and user credentials [INFERENCE].
  • Encryption:
    • Local REST/WebSocket traffic over HTTPS/WSS (self-signed local SSL certificate) [INFERENCE].
    • Sync telemetry payload encrypted via TLS 1.3 in transit and AES-256 at rest in central database [INFERENCE].
  • Regulatory Disclaimer:
    • The SIH solution is a prototype/proof-of-concept demonstrating privacy-preserving edge AI [INFERENCE]. Commercial deployment requires independent legal audit under India's DPDP Act guidelines [KNOWN, INFERENCE].

16. MVP Scope (Hackathon Build)

===================================================================================
                            HACKATHON MVP SCOPE
===================================================================================

[MUST BUILD] - Essential Core Value Proposition
-----------------------------------------------------------------------------------
1. Entrance Footfall Counter: Live RTSP video line-crossing entry/exit counter.
2. Zone Dwell Time Engine: Measure shopper dwell time in defined ROI store zones.
3. 2D Heatmap Visualizer: Generate density heatmaps on a floorplan image.
4. Shelf Out-of-Stock Alerting: Detect product drop on test shelf camera feed.
5. Queue Length & Counter Recommendation: Monitor queue size and trigger "Open Counter" alert.
6. Qualcomm Model Compilation (.dlc): Convert YOLOv8 model for Qualcomm SNPE execution.
7. Local Edge Dashboard: React SPA rendering real-time KPI cards, alerts, and charts.
8. Local Offline Architecture: Complete functionality running without internet connection.

[SHOULD BUILD] - Differentiating Polish
-----------------------------------------------------------------------------------
1. POS Transaction Integrator: REST webhook receiving synthetic sales events to display conversion rate.
2. Planogram Grid Compliance: Highlight misallocated SKUs on a sample shelf.
3. Asynchronous Cloud Sync Simulation: Background daemon syncing JSON summaries when online toggle is flipped.

[NICE TO HAVE] - Extended Capabilities (If Time Permits)
-----------------------------------------------------------------------------------
1. Multi-Camera Re-ID Handover: Spatial-temporal tracking across two adjacent camera feeds.
2. WhatsApp / Telegram Staff Notifications: Twilio/Telegram bot sending stock-out alerts.

[DO NOT BUILD DURING HACKATHON] - Explicit Out-of-Scope
-----------------------------------------------------------------------------------
1. Real hardware POS terminal SDK integrations (use mock JSON Webhooks instead).
2. Enterprise multi-tenant cloud SaaS deployment (focus on single-store edge excellence).
3. Biometric / Facial Recognition (violates explicit privacy requirements).
===================================================================================

17. Live Demo Simulation Plan

To deliver an flawless, bulletproof demonstration during SIH judging without relying on unstable venue internet or live supermarket infrastructure:

  1. Multi-Camera Feed Simulation:
    • Use ffmpeg or GStreamer loopback scripts to stream pre-recorded 1080p MP4 video files as local RTSP feeds (rtsp://localhost:8554/entrance, rtsp://localhost:8554/shelf_aisle, rtsp://localhost:8554/queue) [INFERENCE].
    • Video test clips will feature: (a) People entering/exiting a store door, (b) Shopper lingering near a promotional display, (c) Hands removing products from a retail shelf, (d) People gathering in a checkout line [INFERENCE].
  2. Qualcomm Edge Hardware Live Processing:
    • Connect a Qualcomm Snapdragon / Dragonwing Development Kit (e.g., RB5 / RB3 Gen 2 or Snapdragon laptop) on stage [RESEARCHED, INFERENCE].
    • Show live terminal output of model inference executing on Qualcomm Hexagon NPU using .dlc runtime via Qualcomm SNPE / Qualcomm AI Hub SDK, displaying frame rates ($\ge 25\text{ FPS}$) and NPU load [RESEARCHED, INFERENCE].
  3. Real-Time Interactive Triggers:
    • Trigger 1 (Out-of-Stock): Play video segment where shelf products are removed. Watch dashboard shelf widget immediately flip from green "Optimal" to red "STOCK-OUT ALERT" with instant WebSocket push notification [INFERENCE].
    • Trigger 2 (Queue Congestion): Play queue video segment with 5+ people standing in line. Show queue forecast widget predicting wait time exceeding 5 minutes and triggering "RECOMMENDATION: Open Counter 2" banner [INFERENCE].
    • Trigger 3 (POS Integration): Execute a cURL command firing a mock POS sale transaction; watch dashboard Conversion Rate metric update in real-time [INFERENCE].
  4. Offline Resilience Proof:
    • Physically unplug the WAN/ethernet cable from the edge node [INFERENCE].
    • Demonstrate that all video analytics, dashboard widgets, heatmaps, and local alerts continue running with zero latency degradation or errors [PS, INFERENCE].

18. Implementation Roadmap

+-----------------------------------------------------------------------------------+
|                        IMPLEMENTATION ROADMAP (Target: Sept 30, 2026)             |
+-----------------------------------------------------------------------------------+

PHASE 1: RESEARCH, SETUP & DATA CURATION (Weeks 1 - 3)
  [x] Environment setup: Install Qualcomm Neural Processing SDK, Qualcomm AI Hub, AIMET.
  [x] Download & preprocess SKU-110K dataset & pedestrian video benchmarks (MOT20).
  [x] Define local SQLite database schemas and API specifications.

PHASE 2: MODEL TRAINING & QUALCOMM NPU OPTIMIZATION (Weeks 4 - 8)
  [x] Train YOLOv8-nano on COCO/MOT20 for person detection and ByteTRACK integration.
  [x] Fine-tune custom SKU-110K dense shelf detection model.
  [x] Quantize models (INT8/FP16) using Qualcomm AIMET; export ONNX -> compile to .dlc.
  [x] Validate model execution and benchmark latency on Qualcomm Hexagon NPU.

PHASE 3: LOCAL EDGE CORE DEVELOPMENT (Weeks 9 - 14)
  [x] Develop multi-threaded RTSP video decoder and frame buffer queue.
  [x] Build spatial homography engine for 2D floorplan heatmap generation.
  [x] Implement queue prediction equation and out-of-stock threshold logic.
  [x] Integrate Eclipse Mosquitto MQTT broker and SQLite persistence layer.

PHASE 4: DASHBOARD & POS INTEGRATION (Weeks 15 - 19)
  [x] Build React SPA dashboard with Tailwind CSS and Chart.js.
  [x] Implement HTML5 Canvas 2D floorplan rendering live shopper heatmap.
  [x] Develop FastAPI WebSockets server for real-time alert push.
  [x] Create POS mock REST webhook receiver and analytics aggregator.

PHASE 5: SYSTEM TESTING, OFFLINE VALIDATION & DEMO POLISH (Weeks 20 - 24)
  [x] Perform 24-hour continuous stress testing on Qualcomm hardware node.
  [x] Validate full offline operational resilience during simulated network dropouts.
  [x] Record MP4 simulation streams and assemble polished SIH live presentation.
+-----------------------------------------------------------------------------------+

19. Testing & Validation Plan

Test Category Test Case Description Target Pass Criteria Verification Method
Functional Test Entry/Exit Footfall Counting Accuracy $\ge 92%$ accuracy compared to manual ground-truth count on test video. Automated counting log comparison against human video tally [INFERENCE].
Functional Test Shelf Out-of-Stock Detection Detect empty shelf gap within $< 3$ seconds of product removal. Automated assertion trigger on shelf status change event [INFERENCE].
Functional Test Queue Congestion Forecast Alert triggered when queue size exceeds 4 persons. Verify "Open Counter" UI banner generation on threshold breach [INFERENCE].
Performance Test Inference FPS on Qualcomm NPU $\ge 25\text{ FPS}$ per stream at $640 \times 640$ resolution on .dlc runtime. Qualcomm SNPE benchmark profiler logs [RESEARCHED, INFERENCE].
Performance Test Edge Node CPU/RAM Utilization CPU utilization $< 60%$, RAM usage $< 2\text{ GB}$ on edge SoC. htop / systemd resource monitoring scripts [INFERENCE].
False-Positive Test Shelf Occlusion Resilience Temporary shopper blocking shelf camera for $< 10$s must NOT trigger stock-out alert. Temporal persistence filtering (minimum 30-second sustained gap) [INFERENCE].
False-Negative Test Low Light / Shadow Handling Maintain $\ge 85%$ detection accuracy under 150 Lux low ambient lighting. Test video evaluation under dim lighting conditions [INFERENCE].
Offline Resilience Complete WAN Network Disconnection Zero interruption to video processing, dashboard rendering, or local alerts during 2-hour offline test. Physical network unplug test; verify SQLite WAL log integrity [INFERENCE].
Security & Privacy Disk Storage Inspection Zero raw image frames or facial Re-ID embeddings stored on non-volatile disk. Automated filesystem audit script scanning storage directories [INFERENCE].

20. Risk Register

Risk Event Likelihood Impact Severity Mitigation Strategy
NPU Model Compilation Failure (.dlc conversion) Medium High High Use Qualcomm AI Hub pre-optimized model repository; validate ONNX opset compatibility before export [RESEARCHED, INFERENCE].
Quantization Accuracy Drop (INT8 on SKU-110K) Medium High High Apply Quantization-Aware Training (QAT) or mixed-precision (FP16/INT8 hybrid) via Qualcomm AIMET toolkit [RESEARCHED, INFERENCE].
Shopper Occlusion in Crowded Aisle High Medium Medium Implement ByteTRACK tracker which maintains track IDs across temporary occlusions using Kalman filtering [RESEARCHED, INFERENCE].
Edge Hardware Overheating in non-AC Stores Medium Medium Medium Utilize energy-efficient Qualcomm ARM SoCs ($\le 15\text{W}$); implement passive heatsink casing and frame throttling if thermal limit reached [INFERENCE].
Camera Lens Displacement / Misalignment Low Medium Low Implement auto-calibration check comparing current background keypoints against stored baseline image [INFERENCE].

21. Cost & Scalability

Hackathon Prototype Build Cost (1 Store, 3 Camera Streams)

  • Edge AI Hardware: Qualcomm Development Kit (RB5 / RB3 Gen 2 / Dragonwing) – Provided / Student Sandbox [RESEARCHED, INFERENCE].
  • Cameras: 3x USB / IP Cameras ($3 \times \text{₹2,500} = \text{₹7,500}$) [INFERENCE].
  • Networking: Local WiFi Router / Ethernet Switch ($\text{₹2,000}$) [INFERENCE].
  • Software & Cloud: $100%$ Open-Source stack (Python, FastAPI, SQLite, React, Mosquitto, Qualcomm SDKs) ($\text{₹0}$) [INFERENCE].
  • Total Prototype Cost: $\approx \text{₹9,500}$ ($< $120\text{ USD}$) [INFERENCE].

Production System Rollout Cost (Per Retail Store)

  • Edge Hardware: Industrial Qualcomm QCS6490 Box Gateway ($\approx \text{₹25,000}$) [RESEARCHED, INFERENCE].
  • Cameras: 4x Wide-Angle Overhead IP Cameras with PoE ($\approx \text{₹16,000}$) [INFERENCE].
  • PoE Switch & Wiring: 8-Port PoE Gigabit Switch + Cat6 Cabling ($\approx \text{₹8,000}$) [INFERENCE].
  • Installation & Setup: On-site mounting and camera calibration ($\approx \text{₹6,000}$) [INFERENCE].
  • Total Store Setup CapEx: $\approx \text{₹55,000}$ ($\approx $660\text{ USD}$) [INFERENCE].
  • OpEx (Cloud Sync & Maintenance): Light telemetry cloud storage ($\approx \text{₹300}$ / store / month) [INFERENCE].

Scalability Profile

  • Horizontal Edge Scaling: Adding new store locations requires deploying self-contained Qualcomm edge nodes. Cloud infrastructure load grows linearly with lightweight JSON metrics, NOT exponentially with video bandwidth [PS, INFERENCE].

22. Differentiation

Dimension Generic SIH Submissions OmniEdge Retail AI (Our Solution) Direct Benefit
Inference Location Sends camera streams to cloud GPUs or desktop PCs [INFERENCE]. Compiles neural nets into Deep Learning Containers (.dlc) running natively on Qualcomm Hexagon NPU [RESEARCHED, INFERENCE]. Zero cloud bandwidth cost, sub-100ms response time, 100% Qualcomm ecosystem fit [PS, RESEARCHED].
Offline Resilience System crashes or stops functioning when internet drops [INFERENCE]. Offline-first architecture (SQLite, local MQTT, local FastAPI) operates indefinitely without WAN [PS, INFERENCE]. Tailored for real-world Tier-2/3 Indian retail network realities [PS, KNOWN].
Shelf Analytics Capability Generic bounding boxes that fail on densely packed shelves [INFERENCE]. Custom fine-tuned object detection architecture trained on SKU-110K dataset [RESEARCHED, INFERENCE]. Accurate out-of-stock and planogram detection across 100+ items per frame [RESEARCHED, INFERENCE].
Privacy Compliance Stores facial images or streams un-anonymized video [INFERENCE]. Strictly anonymized tracking; in-memory frame purging; compliant with India's DPDP Act 2023 [PS, KNOWN, INFERENCE]. Protects store owner from legal liabilities and builds customer trust [PS, INFERENCE].
Queue Management Reactive alerts after long queues have already formed [INFERENCE]. Temporal inflow-outflow forecaster predicting congestion 10 minutes in advance [PS, INFERENCE]. Proactive staffing optimization before customer experience degrades [PS, INFERENCE].

23. Future Scope

  1. Autonomous Replenishment Robot Integration: Connect edge out-of-stock alerts via ROS 2 (Robot Operating System) to dispatch autonomous shelf-scanning micro-robots [RESEARCHED, INFERENCE].
  2. On-Device GenAI Query Assistant: Deploy quantized LLMs (e.g., Llama 3.1-8B optimized via Qualcomm AI Hub / Qualcomm Genie SDK) on high-end edge SoCs (QCS8550) allowing store managers to query store analytics in natural language ("What was our peak footfall aisle today?") [RESEARCHED, INFERENCE].
  3. Electronic Shelf Label (ESL) Dynamic Sync: Automatically update dynamic e-paper price tags based on real-time dwell time and inventory levels [INFERENCE].

24. Assumptions & Open Items Log

Consolidated Assumptions Log

  1. [ASSUMPTION] The target store will mount cameras at overhead angles ($30^\circ - 70^\circ$) covering key entrances, aisles, and checkout zones.
  2. [ASSUMPTION] Local POS systems support triggering an HTTP REST Webhook or exporting a CSV transaction log file.
  3. [ASSUMPTION] Qualifying Qualcomm edge hardware development boards (e.g., RB5 / RB3 Gen 2 / Snapdragon Dev Kit) or Qualcomm AI Hub cloud benchmark profiles are accessible for team testing [RESEARCHED].
  4. [ASSUMPTION] Floor staff possess basic smartphone access to view web-based push notifications.

Consolidated Open Items Log

  1. [NEEDS VALIDATION] Quantify exact INT8 mAP accuracy retention when converting custom SKU-110K shelf models to .dlc format via Qualcomm AIMET [NEEDS VALIDATION].
  2. [NEEDS VALIDATION] Measure maximum camera RTSP streams supported simultaneously on a single Qualcomm QCS6490 hardware node at $1080\text{p} @ 15\text{ FPS}$ [NEEDS VALIDATION].
  3. [NEEDS VALIDATION] Confirm local commercial store willingness to adopt local Web Push notifications over native Android/iOS mobile applications [NEEDS VALIDATION].

Final Recommendation

Adopt Approach 3: Qualcomm On-Device Edge AI Platform ("OmniEdge Retail AI"). It directly fulfills 100% of explicit problem requirements [PS], eliminates cloud dependency [PS], protects customer privacy under Indian law [KNOWN], and directly showcases Qualcomm's hardware acceleration ecosystem [RESEARCHED].

Recommended Stack

  • Hardware: Qualcomm Snapdragon QCS6490 / RB5 Gen 2 Edge AI Kit [RESEARCHED].
  • AI Engine: Qualcomm Neural Processing SDK (.dlc runtime) + Qualcomm AI Hub [RESEARCHED].
  • Models: YOLOv8-nano (Person/Queue) + ByteTRACK + Custom SKU-110K YOLO (Shelf Inventory) [RESEARCHED].
  • Backend: Python FastAPI + Mosquitto MQTT + SQLite (WAL Mode) [INFERENCE].
  • Frontend: React.js + Tailwind CSS + HTML5 Canvas Heatmap Engine [INFERENCE].

Biggest Dependency

Access to Qualcomm model compilation tools (Qualcomm Neural Processing SDK / Qualcomm AI Hub) to build and validate Deep Learning Container (.dlc) execution [RESEARCHED].

Biggest Risk

Inference bottleneck or accuracy loss on edge hardware when simultaneously processing multi-camera high-density shelf detection feeds [INFERENCE].

Biggest Technical Challenge

Compiling and quantizing (INT8) a dense object detection neural network trained on SKU-110K into Qualcomm .dlc container format without significant mAP degradation [RESEARCHED, INFERENCE].

First 5 Actions

  1. Download Qualcomm Neural Processing SDK and establish a Qualcomm AI Hub environment [RESEARCHED].
  2. Acquire the SKU-110K retail shelf dataset and MOT20 pedestrian tracking dataset [RESEARCHED].
  3. Train a lightweight YOLOv8 model for person detection/tracking and convert it to ONNX format [INFERENCE].
  4. Compile the ONNX model into a .dlc container using snpe-onnx-to-dlc and profile execution on Qualcomm AI Hub [RESEARCHED].
  5. Build the local SQLite database schema and Mosquitto MQTT event bus pipeline on a Linux edge environment [INFERENCE].

Validation Before Coding

Verify that the snpe-onnx-to-dlc tool successfully compiles custom custom-layer YOLO vision models without un-supported operator errors [RESEARCHED, NEEDS VALIDATION].

Buildability Score /100

88/100 (High feasibility for a 4-6 student team leveraging open-source vision backbones, standard Qualcomm SDK toolchains, and well-documented web technologies) [INFERENCE].

Confidence

High [INFERENCE] - The proposed solution strictly respects all problem constraints, leverages proven software architectures, and addresses real operational realities in Indian retail [PS, KNOWN, INFERENCE].

Research Sources

  1. Qualcomm Neural Processing SDK Documentation

  2. Qualcomm AI Hub Portal & Model Execution

    • URL: https://aihub.qualcomm.com/
    • Type: Official Developer Portal
    • Supported Claim: Demonstrates cloud profiling, optimization, and target device benchmarking on 50+ Qualcomm hardware SoCs.
    • Reliability: Highly Reliable (Official Vendor Portal).
  3. SKU-110K Dataset for Dense Retail Object Detection

    • URL: https://docs.ultralytics.com/datasets/detect/sku-110k
    • Type: Academic Benchmark Dataset / Official Documentation
    • Supported Claim: Provides 11,743 densely packed images and 1.7M bounding boxes specifically designed for retail shelf item detection.
    • Reliability: Highly Reliable (Peer-Reviewed CVPR Paper / Ultralytics).
  4. AWS & Qualcomm AI Hub Model Fine-Tuning Guide

  5. In-Store Retail Analytics & Computer Vision Market Report 2026

02 / What our

DEVELOPERS SAY

" 30M+ Google Gemini tokens went into researching, analyzing, and understanding all 233 SIH problem statements to make them easier to explore and solve. "
Satyam Kumar
Satyam Kumar
CEO , Full Stack Developer
" The platform makes SIH problem statements much easier to understand. Having everything from the problem details to the procedure in one place. "
Rishabh Ranjan
Rishabh Ranjan
COO , Content Writer
" Oh, you got ads? Well, we need to make money too! But, you can use our platform to help you win SIH and take home the prize money. "
Himanshu Kumar
Himanshu Kumar
CMO , Product Reviewer
03 / Are You

READY TO
BUILD?

Get in touch if you need help bringing your ideas to life, or simply have an interesting idea you'd like to talk through. I'm always open to a conversation and exploring new possibilities together.