UNCLASSIFIED
Submarine Electro-Optical Imaging:
Future Imaging System Architecture
Presented to: National Defense Industrial Association
2002 Joint Undersea Warfare Conference
Presented By: Mr. Swarn Dulai, PMS 435 I&EW Chief Engineer
Naval Sea Systems Command
Submarine Sensor Systems Program Office
Imaging and Electronic Warfare
E-mail:dulaiss@navsea.navy.mil
Telephone:(202)781-4331
UNCLASSIFIED
Submarine Imaging Systems
Tomorrow
Today
Yesterday
UNCLASSIFIED
NDIA SEP 02
2
Imaging System Overview
Object
Background
ATMO
Optics
Sensor
Video
Front-end
Processing
LOS training,
vibration/motion
compensation
General
Purpose
Processor
Image
Display
Imagery
Storage
TC/
IM
Human
Observer
Utilize an end-to-end system
approach to ensure a
balanced technology
insertion program
UNCLASSIFIED
NDIA SEP 02
3
Submarine Imaging Systems
• Current Systems
– Submarine Imaging System (SUBIS)
»
»
»
»
»
Implemented as Type 18 subsystem
Color TV Camera – Sony XC-999 (768X494 pixels)
Color Still Pictures – Nikon D1 (2000X1312 pixels)
Low Level Light Television (LLLTV) Camera – Xybion ISS-850 (480 TV Lines)
Workstation for Capture / Storage / Recall
– Photonics Mast Program (PMP) (VIRGINIA CLASS Only)
»
»
»
»
»
»
Non-Penetrating Mast
Color TV Camera - Sony 007 (640X480 pixels)
Monochrome – Sony XCH1125 (1940X1040 pixels)
IR Cameras - Cincinnati Electronics Night Conqueror (640X512 pixels)
Automatic 360-degree sweep
Imaging Processing / Storage / Recall
• Near Term Demonstrations
– Integrated Imaging System (I2S)
• Future Systems
– UAV/UUV Sensors
UNCLASSIFIED
NDIA SEP 02
4
Planned Installations
• SUBIS
– 26 Systems Procured
• 14 Installed
• 12 Completed By End of FY03
– Planned Procurement for All Submarines In Process
• Photonics
– VIRGINIA CLASS (Forward Fit)
• Integrated Imaging System
– Automatic Rangefinder, IR, Video Mosaic Remote Control
Imaging Sensor, Automatic Object Detection and Tracking,
Super Resolution, Image Fusion, Etc.
– Development completed in FY04, Installations Start FY05
– Backfit all In-Service Submarine Classes
UNCLASSIFIED
NDIA SEP 02
5
Imaging as Part of Submarine
Modernization
• Imaging system sensors
provide ‘eyes’ to the tactical
picture
TS / SCI
ECS
Modem
ECP-4
ESM
Imaging
Contact Data
Sensor Data
– Raw Imagery (Present)
• Color Video
• Digital Still Frames
• Low Light Level Video
Sensor Data
TFDS
Radar
Time Data
Sensor Data
TIDS
Tactical LAN
– Near Term Demonstrations
(I2S)
RLGN
ARCI
NAV Data
Sensor Data
GCCS-M
Central Mgr,
IPSec & DAR
Contact Data
NTCSS
SEA-08
Users
Gate Guard
ECS
Modem
SIPRNET
IT-21
Users
Secret & below
Potentially S+
UNCLASSIFIED
• Video Mosaic (wide field of view)
• Remote Control Imaging Sensor
• Automatic Object Detection and
Tracking
• Contact parameter estimation
• Super Resolution
• Image Fusion
• Infrared Sensor
• Supports push/pull to/from other
SWS subsystems
• Automated Rangefinding
NDIA SEP 02
6
Objectives
• Address Fleet’s Imaging Requirements
– Develop an Open System Architecture for Imaging
System Technology Insertion
– Establish Process to Enable Rapid Insertion of New
Technologies into Submarine Imaging Systems.
– Define Hardware and Software Architecture to
Support COTS Imaging Sensors, Image Processing
Algorithms, and Advanced Displays.
– Fuse Sensors Data to Provide an Enhanced Common
Tactical Picture.
– Balance Performance, Cost, and Schedule
UNCLASSIFIED
NDIA SEP 02
7
Building Upon the Imaging System
Architecture
Remote Control
Mosaic generation
Image Fusion
Tactical Control
Information Manager
Workstation
Imaging Sensors
Automated contact detection,
Classification,
Parameter extraction
Image and Video
Indexing
Image
Enhancement
UNCLASSIFIED
ONI Ship
Characteristic
Database
NDIA SEP 02
8
Future Integrated Imaging System (I2S)
Display
SUBIS
Photonics
•Color
•B&W
•IR
Other / Future
•Video
•IR
•Panoramic
•Etc.
HMI Display
Processing
Video Multiplexer
•Color
•LLLTV
•Digital Still
Display
Image Processing
Imaging Database
Periscope
Function
Contact Analysis
Interfaces G/G
KBD
TRK
GRIP
UNCLASSIFIED
Sensor Control
FOV, AZ, EL,
LOS Control,
Camera Select
SWS/TIDS
Nav Data
Range
ESM Data
Sonar Data
NDIA SEP 02
9
Video and Image Processing
Video (Color)
Video (IR)
Digital Still Frames
Frame-to-Frame
Image Stabilization
Frame
Integrate
Real Time
Video Image
Fusion
Real Time
Video
Processing
Image
Mosaic
Super
Resolution
Display Systems
Contact Analysis
UNCLASSIFIED
NDIA SEP 02
10
Contact Analysis Flow
-Mosaic
-Super Resolution
-Frame Integrated
-Image Enhanced
Video/Still
Image
Processing
Start
Contact Analysis
Programmed
search
Search
Bearing
Remote
Control
Hi Priority
Targets
Manual Target
Mensuration
Available in
Photonics Mast
Manual
Contact Report
Generated
Automatic
Target
Detection
-Video Frame Grab
-Digital Still
-Enhanced Video Frame Grab
-Fused Video Frame Grab
-Super-Resolution Frame
Time
Bearing
Automatic
Target
Bounding
Geosit &
Trip Wire
Display
Bounding box
and/or target
contour
Contact Report
Automatic
Target
Mensuration
Ship
Database
Contact Report
Target
Tracking
Classification
Range
Angle on Bow
UNCLASSIFIED
NDIA SEP 02
11
Mapping New Capabilities to Imaging
System Architecture
• High Speed Imaging Sensor Processor (front end)
– Frame-to-frame registration
– Frame store and distribution
– Video rate image fusion
• General Purpose Processor
–
–
–
–
–
–
–
Video rate processing (simple FIR filtering)
Contact analysis capabilities
Remote control of periscope functions
External interface management
Video and image database management
Video and image server
GUI and support function processing
• Display Processor
– Display processing
– Head Up Display
– Virtual Reality
UNCLASSIFIED
NDIA SEP 02
12
Video Image Mosaic/Scene Stitching
Type 8 ESM
Super Resolution of IR Digital Output
Precision Frame Integration
Periscope Radar Range Finder
Image Stabilization
Image Fusion of IR and Visual Mosaics
Automatic Target Detection
Automated Target Bounding Box
TIDS Connectivity
Imaging Mast Workstation Replacement
Increase Imaging System Bandwidth
Digital Still Image Mosaic/Scene Stitching
Super Resolution of all Imagery
Automated Target Classification and Identification
Automated Sensor Control (Programmable Searches)
UNCLASSIFIED
Fleet
Intro
Improvement
APB
Testing
Sensor Upgrades & APB Process
2002
2003
2003
2003
2003
2003
2003
2003
2003
2003
2003
2004
2004
2005
2005
2005
2003
2004
2004
2004
2004
2004
2004
2004
2004
2004
2004
2005
2005
2006
2006
2006
APB
X
X
X
X
X
X
X
X
X
X
X
X
NDIA SEP 02
13
Challenge To
Our Industry Partners
Push Technology to Improve:
• Advanced Imaging Sensors For Comprehensive Spatial,
Temporal, and Spectral Coverage
• High Data Rate Interface
• Modular Signal and Data Processing Equipment
• High Resolution Displays
• Applications Software (image processing, target
acquisition, display processing)
• Software Reuse
Industry Participation is KEY to Achieving Our Submarine Imaging Goals
UNCLASSIFIED
NDIA SEP 02
14