Multi-Domain Targeting Alignment
Problem Statement
“In support of the transition to a hybrid fleet and enhanced target classification across all domains, identify Automatic Target Recognition (ATR) technologies capable of detecting, classifying, and distinguishing friendly, adversarial, and high-interest targets across multiple platforms (manned and unmanned) and sensor domains.”
Traditional automatic target recognition models struggle to accurately detect, classify and distinguish targets in complex, multi-domain environments.
This is a personal pain point. During my master's thesis at Cornell Tech's AI Lab, our team developed a solution that used the YOLO algorithm to track target objects, and noticed the accuracy limitations of existing AI models in multi-domain situations.
Limitations with the Current Approach
Across multi-domains such as land, air and sea, most published datasets are narrow in scope (limited object types, resolution, or scale), resulting in limited model accuracy and generalizability.
Dataset | Model | Images / Classes | Metric | Result |
---|---|---|---|---|
Multi-Scale Marine SSS | YOLO | 1 584 / 5 | mAP0.5 | 92.4 % |
Trash_ICRA19 | YOLOv5-Improved | 6 540 / 3 | mAP | 90.6 % |
RUOD | YOLOF | 14 000 / 10 | mAP0.5:0.95 | 50.1 % |
The biggest bottleneck to improving model accuracy is the data. In order to reduce classification errors and accelerate information sharing, there is a need to curate relevant training and evaluation datasets for broad anomaly coverage.
Downsides of Manual Data Curation And Labeling
In order to curate training datasets and evaluation datasets for multi-domain tracking, the DOD currently has people manually going through data to annotate images and other unstructured data types with categories and bounding boxes. This has the following downsides:
Issue | Description |
---|---|
Time Consuming | Slow, even with an unlimited labor force, it can take months to years |
Costly | Expensive, takes up a significant portion of a team’s budget |
Tedious | Laborious, mundane and boring work that people shouldn’t have to do |
Requires Expertise | Hard, requires highly trained subject matter expertise with domain-specific experience to find information |
Iterative | Repetitive, when new data or new categories are added, or business requirements change, humans need to manually go through the data |
Business Model and Value Add
A really accurate AI solution can help automate the tagging of this information and would reduce operator burden and increase autonomy. By leveraging Anote’s AI solution, the Navy can reduce data processing time from months to weeks, mitigate the risk of human error, and rapidly adapt to new categories or requirements to improve operational resilience and model accuracy.
Metric | Current Process | Anote Solution |
---|---|---|
Personnel | 1,200 | 50 |
Annual Cost / Person | $80,000 | $80,000 |
Product / PoC Cost | — | $X |
Time to Label | 1 yr | 1 mo |
Annual Spend | $96 M | $4.2 M |
Market Opportunity and Dual Use Potential
Our team has done a lot of research on benchmark datasets across land, air and sea. Below you can see a few dual use cases that our team has been benchmarking to show how these models can operate in complex, real-world conditions.
Civil / Federal Domain | Representative Use-Case | Key ATR Requirement |
---|---|---|
Domestic Service Robot | Retrieve laundry; load dishes in cluttered homes | Robust close-range detection under occlusion & variable lighting |
Army AI Grand Challenge | Sub-second hostile-asset detection in aerial & ground feeds | Low-latency inference; camouflage resilience |
NGA Satellite Pipeline | National-scale mapping & change detection | Wide-area scanning; mis-label audit |
NYC Subway Security | Real-time threat & crowd-flow monitoring | Weapon recognition in crowded scenes; anomaly detection |