NaeonAIr - AI Eye for the Sky
by prithwisd in Circuits > Raspberry Pi
83 Views, 0 Favorites, 0 Comments
NaeonAIr - AI Eye for the Sky
NaeonAIr is a scalable smart-city safety platform that turns drones into intelligent airborne sensors, powered by edge AI, computer vision, and an IoT data backbone.
π The Problem
Crowd disasters rarely happen without warning.
Before a crush incident occurs, there are measurable warning signs:
- Rising crowd density
- Conflicting movement flows
- Increasing physical pressure between groups
Unfortunately, ground-based cameras and human monitoring often fail to detect these patterns early enough.
We asked:
What if a network of AI-powered drones could monitor crowd conditions from above and warn authorities before danger escalates?
That idea became NaeonAIr β AI Eye in the Sky.
β¨ What Is NaeonAIr?
NaeonAIr is an end-to-end AIoT ecosystem that combines:
πΈ Smart drone payloads
π§ Edge AI processing (Jetson Nano gateway)
π€ Crowd risk analysis server
π Smart city IoT integration (oneM2M Mobius)
π₯ Real-time TypeScript monitoring dashboard
Together, they form a digital twin of crowd safety.
Supplies
This project consists of three main parts:
Drone AI Payload
Jetson Nano Edge Gateway
Server & Dashboard System
Drone AI Payload (Per Drone)
Drone frame + motors + propellers β UAV platform to carry the payload
Flight Controller (F405 or compatible) β Flight stabilization and power distribution
ESC (with 5V BEC output) β Motor control and 5V power supply
3S LiPo Battery β Main power source
XT60 Connector β Battery connection
ESP32-CAM (OV2640) β Captures aerial images/video
Raspberry Pi Pico 2W β Payload microcontroller (GPS + servo control)
NEO-6M GPS Module β Provides location data
Servo Motor β Optional signaling/actuation experiments
Jumper Wires β Electrical connections
Mounting Brackets / 3D Printed Mounts β To secure payload to drone
Vibration Damping Pads β Reduces camera shake
Edge Gateway (Ground Station)
NVIDIA Jetson Nano β AI gateway and inference server
Jetson Nano Power Supply (5V 4A) β Stable power for Jetson
MicroSD Card (32GB+) β OS and software storage
WiFi Router / Access Point β Network communication with drones and dashboard
Ethernet Cable (optional) β Wired network connection
AI & Backend Server
Jetson Nano (same device) β Runs AI inference and risk analysis
Python 3.x β Backend programming language
YOLO Model Weights β Person detection from aerial images
FastAPI β REST API server for analysis
Mobius oneM2M Server β Smart city IoT data platform
Monitoring Dashboard
Laptop or PC β Runs the dashboard interface
Modern Web Browser β Displays dashboard
Node.js β Runs TypeScript/React frontend
TypeScript + React β Dashboard framework
3D Map Library (MapboxJS) β 3D city visualization
Optional but Recommended
External WiFi Antennas β Better long-range drone communication
Portable Power Station β Field deployment of Jetson gateway
Tripod or Ground Mount β Stable placement for gateway equipment
This setup allows you to build a scalable AI drone monitoring system capable of analyzing real-time crowd safety and supporting up to 100 devices through the Jetson Nano gateway.
π§© System Overview
Each layer has a specific role in turning raw aerial footage into actionable safety intelligence.
π Drone AI Payload (Edge Sensing Unit)
Each drone carries a lightweight AIoT payload module that transforms it into a flying sensor node.
π§ Hardware Components
ESP32-CAM (OV2640) β Captures aerial images/video
Raspberry Pi Pico 2W β Controls GPS, servo, and communication
NEO-6M GPS β Provides geolocation tagging
F405 Flight Controller β Integrates with UAV power & telemetry
Servo Motor β Enables physical signaling experiments
LiPo Battery + ESC β Power system
The drone does not perform heavy AI processing β it focuses on data capture and transmission.
π‘ What Each Drone Sends
Each drone transmits:
- Captured images
- GPS coordinates
- Device ID
These are sent to the ground gateway for centralized processing.
π§ Set Up Jetson Nano Edge Gateway (Fleet Brain)
At the center of NaeonAIr is an NVIDIA Jetson Nano, which acts as the edge AI gateway for the entire drone network. Instead of running heavy AI models on every drone, we use the Jetson as a centralized processing hub. This makes the system lighter, more scalable, and easier to manage.
π¦ What the Jetson Nano Does
The Jetson works like a control tower for up to 100 drones.
Device Hub β Handles communication with multiple drones at the same time
Stream Router β Sends live video feeds to the monitoring dashboard
AI Processing Node β Runs the crowd detection and risk analysis services
IoT Bridge β Uploads results to the Mobius smart-city platform
Local Decision Layer β Can continue working even if internet is unstable
This design allows the drones to stay lightweight while the Jetson handles the heavy AI computation.
π Hybrid Data Flow Architecture
To keep the system both fast and scalable, we use two types of communication:
β‘ Real-Time Monitoring (Low Latency)
- For live viewing, the gateway communicates directly with the dashboard:
This provides instant video and status updates with minimal delay.
π AI & IoT Data Pipeline
- For analysis and long-term storage:
This separates real-time streaming from data storage, keeping both efficient.
π§ Smart Media Handling (Why We Donβt Upload Images to IoT)
Images are large, and IoT platforms are not designed for heavy media storage.
So instead of uploading images directly to Mobius:
- The AI server stores images locally
- Only the image URL + analysis metadata are sent to Mobius
This keeps the IoT system lightweight while still allowing operators to view images when needed.
By using the Jetson Nano as a gateway, the system becomes:
β Scalable to large events
β Capable of managing many drones
β Efficient in both real-time and cloud-connected modes
This is what transforms NaeonAIr from a single drone demo into a city-scale AI monitoring system.
π€ Build the AI Crowd Risk Analysis Server
Now that drone images reach the gateway, we need a system that can understand whatβs happening in the crowd.
This is the role of the AI Crowd Risk Analysis Server.
It transforms raw aerial images into actionable safety intelligence.
π Part 1: Detect People Using AI (YOLO)
The first step is identifying people in each drone image.
We use a fine-tuned YOLO (You Only Look Once) model trained for aerial/top-down views.
Pipeline:
Output from this step:
- Total crowd count
- Locations of people in the scene
This gives us the βwhereβ and βhow manyβ, but not yet the danger level.
π Part 2: Analyze Crowd Flow & Pressure
Crowd disasters often happen not just because of density, but because:
Moving groups push into already dense areas, creating dangerous compression.
So we go beyond counting people.
We analyze motion between frames to estimate:
- Direction of movement of crowd clusters
- Differences in speed between neighboring groups
- Areas where movement slows but incoming flow continues
These interactions produce a crowd pressure metric, which is strongly linked to crush risk.
This is what separates NaeonAIr from simple people-counting systems.
β οΈ Part 3: Calculate the Risk Score
Finally, we combine multiple indicators into one easy-to-understand safety signal.
The system considers:
- π₯ Total crowd count
- π Density trends over time
- π Movement flow patterns
- π§± Pressure indicators
These are fused into:
Instead of just showing numbers, the system provides an early warning level that can help responders act before a situation becomes critical.
π Connect the System to a Smart City Platform (Mobius OneM2M)
Once the AI server calculates crowd risk, the data shouldnβt just stay on one computer.
To make the system useful at a city scale, we connect it to Mobius, a oneM2M-based IoT platform.
Mobius acts as a central data hub where crowd analytics, drone status, and alerts can be stored and accessed by other systems.
π¦ How Data Is Organized in Mobius
Inside Mobius, we create an application entity for the drone system:
Each part has a role:
- crowd_analysis β Stores AI results (crowd count, density level, risk score)
- drone_status β Stores drone telemetry (GPS, altitude, battery, device ID)
- alerts β Stores warnings when risk levels become high
This structure keeps data organized and easy to access for dashboards or other city systems.
π Why Smart City Integration Matters
By sending data to Mobius, the system becomes more than a local experiment.
It enables:
- π Historical analysis of crowd conditions over time
- π Integration with other smart city services (traffic, emergency systems, etc.)
- π₯ City-wide monitoring dashboards that combine data from many sources
Instead of one drone feeding one screen, NaeonAIr becomes part of a connected urban safety network.
π₯ Build the Real-Time Monitoring Dashboard (TypeScript)
AI results are only useful if people can understand them quickly.
Thatβs why NaeonAIr includes a web-based monitoring dashboard built with TypeScript.
This dashboard acts as the live control and visualization center for the entire drone network.
It connects to:
- The Jetson Nano gateway for live streams
- The Mobius IoT platform for AI analysis results
π Key Dashboard Features
The primary components include:
π¦ Device Management
Operators can manage the entire drone fleet from one screen:
- Register multiple drone devices
- View which drones are active or offline
- Monitor incoming data per device
This makes the system scalable beyond a single drone.
π§ AI Mode Selection
Different situations require different views. The dashboard allows operators to switch between analysis modes:
Density β Visualizes how crowded an area is
Danger β Displays the AI-estimated crowd risk level
This helps users focus on either crowd size or potential danger buildup.
π· Live Camera Streams
Operators can view real-time video feeds from drone cameras.
This provides:
- Visual confirmation of AI results
- Context for alerts
- Better situational awareness during events
π 3D Map-Based Risk Visualization
Instead of showing only numbers, the system overlays risk data on a 3D city map.
This allows operators to:
- Understand where risk is increasing
- Track crowd movement patterns across areas
- Make faster, location-based decisions in emergencies
Itβs not just data β itβs spatial risk awareness.
π Scalability & Future Expansion
Because the system is gateway-based, it can support:
- Up to 100 drone devices
- CCTV cameras
- Fixed smart sensors
- Mobile robots
All follow the same pipeline:
β οΈ Safety & Ethical Considerations
NaeonAIr is a research and safety-support system.
- Must comply with UAV flight regulations
- Must respect privacy laws
- Designed for crowd safety monitoring, not surveillance misuse
- Supports human decision-makers, not autonomous enforcement
π Our Vision
NaeonAIr transforms drones from flying cameras into:
AI-powered, city-scale crowd safety sensors
By combining edge AI, computer vision, IoT integration, and real-time visualization, the system provides a digital twin of crowd risk β enabling faster, smarter, and safer event management.
To contribute and explore more, please visit our repositories:
- https://github.com/SUNSET-Sejong-University/NaeonAir (For hardware code and gateway)
- https://github.com/SUNSET-Sejong-University/wisdrone-interface (For interface and system integration)
- https://github.com/SUNSET-Sejong-University/wisdrone-ai-drone (For AI server and algorithm)
π₯ Credits
NaeonAIr β AI Eye in the Sky was developed as a collaborative research and engineering project by:
π¨βπ» Choi Hyong Chan
AI Systems β’ Dashboard Architecture
- Real-time monitoring interface (TypeScript dashboard)
- System integration and deployment
- Mobius (oneM2M) IoT platform integration
π¨βπ» Kang Naeon
AI & Data Intelligence β’ Smart City Integration
- Crowd risk analysis algorithms
- AI inference pipeline
π¨βπ» Das Prithwis
Embedded Systems β’ Drone Hardware β’ Communication
- Drone payload electronics
- ESP32-CAM imaging system
- Wireless communication pipeline
- Jetson Nano gateway design