Eric Goujou – Regional Marketing EMEA
IP Camera Solutions
March 2012
V 1.2
NXP Confidential
IP Camera – March 2012
1
Content
IP Camera market, trends, key advantages
NXP Solution: ASC885x
– Key features
– Key performance
Roadmap
– ASC88xx A(dvanced)
– ASC883x
Support Structure and Collateral
NXP’s Value Proposition
NXP Confidential
IP Camera – March 2012
2
IP Camera
Market segment and application
Building & Access
Control
Street Lighting
Surveillance
Traffic Control
Wireless Video
Cameras
Transportation
Journey Data
Management
Gaming Recording
Long train doors
monitoring
Surgery Video
Assistance
NXP Confidential
Long Range
Surveillance
IP Camera – March 2012
3
Acronyms and Definition
DVR
• Any digital video recorder (DVR) designed for use in video surveillance applications that records
images on to a hard disk.
• Coaxial cables from analogue cameras are connected to the unit.
• DVR encodes the analogue output from these cameras to a digital format (MJPEG or
MPEG-4)
Analogue Matrix Switchers
• Links all of the camera inputs and monitor sequentially the output via a matrix.
Network Camera
• Any camera that has its own IP address and built-in wired or wireless network capability.
Hardware Network Video Recorders (NVRs)
• A network video recorder (NVR) is a storage device that records digital images directly from the
network.
Video Encoder
• Device that encoded video input from Analog Cameras to Digital Format
NXP Confidential
IP Camera – March 2012
5
Advantages of IP based security
Support for megapixel sensor (HD) , providing a Wider view & Better
Video Quality
Supports the transition from Standard Definition (D1) Analog to HD
Digital Video (HD, 1080P, …)
Ease of installation
Cheaper, higher quality cabling without quality loss (Digital Cat-5
cabling instead of analog composite cable)
Can integrate with facilities management software (POS, badge
readers, etc)
Ease for Video recorders, files management, …
NXP Confidential
IP Camera – March 2012
7
Camera Product Roadmap
= Target Demo/Sample Date
ASC885xA(dvanced)
Advanced
• 1080p/60 H264 compression
• 1355 Mpix Image Processor
• 12 Mpix sensor support
• Improved video quality
ASC885x
• 1080p/45 H264 compression
• 90 Mpix Image Processor
• ARM9 controller
• Dual SDIO
• PCIe
• Gigabit Ethernet, MAC
• USB 2.0
• BT1120 Video Out
Feature Down
ASC883x
Available Now
SEP
OCT
NOV
DEC
• 1080p/30 H264 compression
• 74 Mpix Image Processor
• 5 Mpix sensor support
• 10/100 Ethernet PHY
• Reduced IF (single SDIO, no PCIe, no BT1120 output
• Parallel & MIPI Serial Sensor Interface support
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
DEC
2012
2011
NXP Confidential
IP Camera – March 2012
10
ASC885x NXP IP Camera
Key Features & Advantages
Full Hard-Coded image pipe
Full on-fly setting with no frame drop
Full Hard-Coded video compression (H264, MPEG4, MJPEG)
The very first Hard-Coded motion detection
The largest bandwidth to implement S/W drivers
Pin-to-pin / S/W compatible product family
TFBGA 484 Package, 15x15mm, 0.65mm pitch
H.264 compression
Part
ASC8851
ASC8850
ASC8849
ASC8848
Sensor
ARM
Typical Camera Use
Case
1080p / 45fps
(1080p/30 + 720p/30)
1080p / 30fps
12 Mpix 600 MHz
(1080p/30 + CIF/30)
SXGA / 40fps
5 Mpix 500 MHz
(1.3M@30 + D1@30)
720p / 45fps
5 Mpix 400 MHz
(720p/30 + D1@30)
12 Mpix 600 MHz
NXP Confidential
Power
for Typical
Camera use
case
Max.
Mpix
per second
Max.
SD channels
at 30fps
Max.
Resolution
at 30fps
Max.
1080p
compression
Max.
3 Mpix
compression
Max.
5 Mpix
compression
90
8
3 Mpix
45fps
30fps
11fps
1100mW
60
6
1080p
30fps
20fps
10fps
850mW
50
4
SXGA (1.3M)
25fps
16fps
7.5fps
800mW
40
3
720p
20fps
13fps
5fps
650mW
IP Camera – March 2012
11
NXP IP Camera
ASC885x at a glance
The ARM926 is there
– To receive customized S/W drivers from the end
applications
– To receive eventually customer-proprietary additional
algorithm
Hard-Coded
–
–
–
–
Full image pipe
Motion Detection Analytics
H264 / MPEG4 / MJPEG scaling and compression
Peripherals interface
Image Pipe
– Multiple features are integrated to support image
optimization such as Gamma correction, 16-bit tone
mapping, dynamic contrast enhancement, auto focus
and auto iris…
Sensitivity: 90%
Percentage: 70%
Motion Detection
– Up to 16 arbitrary-size windows
– Independent threshold setting for each window on size
and sensitivity
NXP Confidential
Sensitivity: 60%
Percentage: 30%
IP Camera – March 2012
12
ASC885x Image Signal Processing
Demosaicing (Bayer to RGB)
Color Correction
Digital WDR (Tone mapping/Gamma Correction)
Auto Exposure / Focus / White Balance
Contrast, Brightness, Saturation enhancement
Deinterlacing
Noise Reduction
Edge Enhancement
Lens Distortion Correction
Privacy Mask,Text Overlay
Image Scaling
NXP Confidential
IP Camera – March 2012
13
ASC885x Video Compression
Multi-codec video compression: H264, MPEG4, MJPEG
H264 video compression is latest, highest quality video compression.
– Compresses 1080p video from 960Mbit/sec down to 2Mbit/sec
H264 encoders supports up to 90 Megapixels per second
– Example configurations for h264 encoding:
•
Full HD 1080p @ 45 frames per second (fps)
–
•
Full HD 1080p @ 30 fps and 720p @ 30 fps
–
•
1920x1080x30+1280x720x30 = 60 M/sec + 27 M/sec = 87 Megapixel/sec
8 Standard Definition channels @ 30 frames per second
–
•
1080p x 45 = 1920x1080 x 45 = 2M x 45 = 90 Megapixel/sec
8x SD NTSC x 30 = 8x 720x480 x 30 = 8x 0.35M x 30 = 84 Megapixel/sec
3 Megapixel@25 frames per second + 1 SD@30fps
–
3Mpixelsx25 + 720x480x30 = 85 Megapixel/sec
H264 in ASC8850 supports excellent encoding quality even for 1080p@30fps
@ 2Mbps.
MJPEG engine runs in parallel with H264 encoder
NXP Confidential
IP Camera – March 2012
14
ASC885x – Feature list
Video Input
–
–
–
–
–
Directly interfaces with sensors up to 12M pixel in 16bit-raw
data format (RGB or CMYG), pixel clock up to 180Mhz.
Supports CCD image sensor with external analog front end.
Supports dual quad-multiplexed 656 (Techwell-Intersil
TW2864, Nextchip NX1114/1104, Richnex RN6242)
Supports 2ch 8bit or 1ch 16bit BT-601, 1ch BT.1120
Support NXP HDMI receivers
Image Processor
–
–
–
–
–
–
–
–
–
–
–
Demosaic filter for Bayer RGB and CYGM color filter arrays
3A: Auto White Balance, Auto Exposure, Auto Focus
Color correction, Gamma Correction, 16-bit WDR tone
mapping
Image Adjustment: saturation, brightness, contrast
Lens Distortion Correction (photometric and geometric,
correct barrel and pin-cushion correction)
Digital Image Stabilization
Advanced dynamic contrast enhancement
Image manipulation: cropping, mirroring, flipping, scaling
with arbitrary sizing, motion adaptive deinterlacing
2D Noise reduction, Edge Enhancement, Tone Mapping,
DeInterlacing
Zoom lens control with zoom tracking
Privacy mask
Video Compression
–
–
–
–
–
–
–
–
2M@45fps H264 (1080p@30fps with additional 720p or
multiple SD streams)
8 channel D1@30fps H264 compression
Supports Baseline, Main and High Profile L4.1 with support
for CABAC and CAVLC
Support for MPEG4 simple profile
Low-Latency compression
High quality compression from 1Mbps (for 1080p) upwards
Supports both constant and variable bitrate encoding
Simultaneous MJPEG encoding up to 80Mpixel/sec
NXP Confidential
Video Analytics
– Basic video analytics, such as tripwire, motion detection
(9 arbitrary size windows with independent threshold
settings for each window on size and sensitivity.
– Enhanced analytics via companion PNX1004/5 video
DSP
Video Output
– RGB 24b (1080p@60fps)
– BT.656
– BT.1120
Audio
– 4ch I2S in, 2ch I2S out
– Hardware accelerated AAC
– Other codecs running in SW on ARM
Encrypted streaming
– AES, SHA, DES, 3DES
CPU
–
–
–
–
ARM926EJ-S 16K I-cache, 16K D-cache, running Linux
2.6
DSP instruction extensions and single cycle MAC
ARM Jazelle Technology
EmbeddedIce-RT Logic for real-time debug
Memory
– 2x 16-bit DDR2 or DDR3 800Mhz, each up to 1GByte.
– Memory bus usage for standard IP 1080p use case : 4%
system bus, 40% video bus
Peripherals
– Ethernet 10/100/1000
– USB2.0 OTG
– Dual SPI interface with support for serial flash
– Dual SD/SDIO interface
– 20 bit GPIO
– PCIe 1.1 single
IP Camera – March 2012
15
ASC885x NXP IP Camera
Product Portfolio
Name
ASC8848
ASC8849
ASC8850
ASC8851
9352
9352
9352
9352
12NC
950 62557,
950 63557,
950 64557,
950 65557,
NXP Confidential
551
551
551
551
Description
IP Camera SoC
IP Camera SoC
IP Camera SoC
IP Camera SoC
720p/45fps
1.3M/40fps
1080p/30fps
1080p/45fps
IP Camera – March 2012
16
Key differentiators of NXP’s solution



Very low power consumption (0.65W for 720p/30, <1W for 1080p/30)

Dedicated hardware for compression and video processing

versus power hungry DSP implementation (like TI)
Excellent H.264 encoding capability

Higher video quality

Bitrate factor 2 to 3 lower  e.g. 2 Mb/s @ 1080p/30 !
Support of encoding substream

720p/30 & D1/30 (ASC8848)

1080p/30 & 720p/30 (ASC8851)

Support of SVC-T & ROI

Very high video processing/enhancement capability

NXP supports a very wide range of sensors

And provides customer/application specific tuning service/training

Digital Video Input and Output at 1080p/60

ONVIF Compliant

DDR3 support (versus DDR2 for some competition)

Complete pin-to-pin product family to support all 720p/30  1080p/60

Comes with complete software kit providing high level API for fast TTM at low R&D effort
NXP Confidential
IP Camera – March 2012
17
ASC885x NXP IP Camera
Sales Tools
Samples
– ASC8848, ASC8849, ASC8850, ASC8851
Reference Design
–
–
–
–
Complete functional IP camera with optics
Wide range of sensors
Easy Ethernet connection to PC
Simple user interface with your native browser
Development Board
– Full access to all the functionalities of the video processor
Software Development Kit
– LINUX based environment
– All drivers libraries and sources available
Dedicated Support Site
– www.nxp-asc.com
– Access on documentation, software, FAQ, schematics,
BOM, layout, etc…
– Full access conditioned by a standard NDA
NXP Confidential
IP Camera – March 2012
18
ASC885x NXP IP Camera
ASC8851 - Reference Design Kit Code
OM13200/ASC8851/MN34031, 720p60, manual IRIS
OM13200/ASC8851/MN34031, 720p60, auto IRIS
OM13200/ASC8851/OV5653, manual IRIS
OM13200/ASC8851/OV5653, auto IRIS
OM13200/ASC8851,598, MT9p031, manual iris
OM13200/ASC8851,598, MT9p031, auto iris
ASC8851 - Software Development Board Code
OM13201/ASC8851/MN34031, 720p60, manual IRIS
OM13201/ASC8851/MN34031, 720p60, auto IRIS
OM13201/ASC8851/OV5653, manual IRIS
OM13201/ASC8851/OV5653, auto IRIS
OM13201/ASC8851,598, MT9p031, manual iris
OM13201/ASC8851,598, MT9p031, auto iris
ASC8851 - Sensor and Interface boards Code
OM13202/OV10630 S/B
OM13205/OV5653 S/B
OM13206/OV9710 S/B
OM13201/OV10,598
OM13204/MN34031, 720p60 S/B
OM13207/MN34041/SB
OM13201/MN30,598
OM13201/IM35,598
OM13208/IMX036/SB
OM13201/MT31,598
OM13210/MT9p006/SB
OM13201/HDMI-IN,598
OM13201/HDMI-OUT,598
OM13201/HDSDI-OUT,598
OM13203/TW2866/DB,598
OM13209/AF/StepMot
NXP Confidential
Description
Pan 720p60,RDK, 8851, manual iris
Pan 720p60,RDK, 8851, auto iris
OV 5653, RDK, 8851,manual iris
OV 5653, RDK, 8851, auto iris
Aptina RDK, 8851, manual iris
Aptina RDK, 8851. auto iris
Description
Pan 720p60,EVM, 8851, manual iris
Pan 720p60,EVM, 8851, auto iris
OV 5653, EVM, 8851,manual iris
OV 5653, EVM, 8851, auto iris
Aptina EVM, 8851, manual iris
Aptina EVM, 8851. auto iris
Description
Omnivision OV10630 Sensor board
Omnivision OV5653 Sensor board
Omnivision OV9710 Sensor board
Omnivision OV2715 Sensor Board
Panasonic MN34031, 720p60 Sensor board
Panasonic MN34041 1080p60 Sensor board
Panasonic MN34030 Sensor Board
Sony IMX035 Sensor Board
Sony IMX036 1080p30 SensorBoard
Aptina MT9P031 Sensor Board
Aptina MT9P006 Sensor board
HDMI In Daughter Board for OM13201
HDMI Out Daughter Board for OM13201
HD-SDI Out Daughter Board for OM13201
TW 2866 8-channel daughter Board for OM13201
Auto Focus with stepper motor control
Sales Tools
12NC
935296391598
935296393598
935296396598
935296398598
935296401598
935296403598
12NC
935296406598
935296407598
935296405598
935296404598
935296402598
935296399598
12NC
935296397598
935296392598
935296388598
935293937598
935296394598
935296924598
935293939598
935293938598
935296926598
935293941598
935296928598
935293902598
935293903598
935293904598
935296395598
935296927598
ASC8851 RDK
( OM13200)
ASC8851 EVM
( OM13201)
IP Camera – March 2012
19
ASC885x - Sensor Support
Sensor
Maker
Part #
Resolution
Frame
Max Resolution
720P
1080P
Interface
WDR
Schedule
Aptina
MT9P031
5M
5M @ 15
60
30
Parallel
no
Now
Aptina
MT9P006
5M
5M @ 15
60
30
Parallel
no
Mar'12
Aptina
AR0331
2048x1536 3M
3M @ 30
60
Parallel/HiSPi
Yes/Sensor
Mar'12
Aptina
MT9M034
1280x960
720P @ 60
Parallel/HiSPi
Yes/FPGA
Mar'12
OmniVision
OV2715
1920x1080
1080P @ 30
Parallel
no
Now
OmniVision
OV9715
1280x800
1280x800 @ 30
30
Parallel
no
Now
OmniVision
OV10633
1280x800
1280x800 @ 30
30
Parallel
Yes/Sensor
Now
OmniVision
OV5653
5M
5M @ 15
60
Parallel
no
Now
Panasonic
MN34031
1280x1024
1280x1024 @ 30
30
Parallel
no
Now
Panasonic
MN34031
1280x1024
1280x1024 @ 60
60
Serial
no
Now
Panasonic
MN34031
1280x1024
1280x1024 @ 30
30
Serial
Yes/FPGA
Mar'12
Panasonic
MN34041
1944x1092
1944x1092 @ 60
60
Serial
No
Now
Panasonic
Panasonic
MN34041
MN34041
1944x1092
1944x1092
1944x1092 @ 30
1944x1092 @ 60
30
60
Serial
Serial
Yes/FPGA
No
Mar'12
Mar'12
Sony
IMX036
2048x1536
1080P @ 30
30
Parallel
No
Now
Sony
IMX122
1936x1217
1080P @ 30
30
Parallel
No
Now
NXP Confidential
60
30
30
IP Camera – March 2012
21
Roadmap
Next Generation Products
ASC885x A(dvanced) solution for higher framing rate
ASC883x Optimized solution for Low Cost IP Camera
CONFIDENTIAL – BL TVFE, PL Cable
NXP Confidential
IP Camera – March 2012
22
22
Camera Product Roadmap
= Target Demo/Sample Date
ASC885xA(dvanced)
Advanced
• 1080p/60 H264 compression
• 135 Mpix Image Processor
• 12 Mpix sensor support
• Improved video quality
ASC885x
• 1080p/45 H264 compression
• 90 Mpix Image Processor
• ARM9 controller
• Dual SDIO
• PCIe
• Gigabit Ethernet, MAC
• USB 2.0
• BT1120 Video Out
Feature Down
ASC883x
Available Now
SEP
OCT
NOV
DEC
• 1080p/30 H264 compression
• 74 Mpix Image Processor
• 5 Mpix sensor support
• 10/100 Ethernet PHY
• Reduced IF (single SDIO, no PCIe, no BT1120 output
• Parallel & MIPI Serial Sensor Interface support
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
DEC
2012
2011
NXP Confidential
IP Camera – March 2012
23
Advanced ASC884x/5xA
Towards 1080p60
At 60fps the maximum exposure time is reduced
– Lower signal level from same technology pixel
Random noise level doesn’t decrease with reduced exposure time
– The result is lower signal-to-noise ratio at higher frame rate.
ISP (image signal processor) needs improvement.
ASC8852A (“A”dvanced) addresses this with better noise reduction in ISP.
– ASC8850/51 provide good picture quality at 1080p30 video.
– ASC8852 uses same ISP as ASC8851 which is not optimal for 1080p60
ASC8852A supports 1080P/60 & D1/30 and includes additional features to
implement more advanced 3A algorithms
The Advanced features will also be available in:
– 8848A (720p/30 & D1/30)
– 8851A (1080p/30 & D1/30)
The Advanced versions of the 884x/5x are pin-compatible with the current devices
NXP Confidential
IP Camera – March 2012
•
24
Highlights of ASC8852A
Higher H.264 encoder performance
– Additional D1@30fps stream on top of 1080p60 main stream
– Higher resolution inputs (width upto 5120 pixels) can linearly use encoder
performance of 134MP/sec (e.g. 5M @26fps)
Improved image processing pipe
–
–
–
–
–
3D noise reduction
A larger kernel for edge enhancement enables better continuity of edges
12-bit Gamma correction for better detail in picture
Included R,G,B histograms with 64 bins, which enables advanced AE algorithms
Independent black clamp for all four channels (R, B, Gb, Gr) to compensate for
“possible” different offset in each channel.
More flexible 3A accumulators for advanced algorithms
– AE : 1 Global + 16x16 cell values
– AWB : 1 Global + 16x16 cell values
– AF : 1 Global + 8x8 cell values
Pin to pin compatible with current ASC884x and ASC885x products
NXP Confidential
IP Camera – March 2012
•
25
Support and Collateral
CONFIDENTIAL – BL TVFE, PL Cable
NXP Confidential
IP Camera – March 2012
28
28
Support: www.nxp-asc.com
Register as a user
Get information
Download latest software/docs
Submit and follow up on tickets
NXP Confidential
IP Camera – March 2012
29
Support: www.nxp-asc.com - FAQ
An NDA must be signed
Customer must register in
order they get appropriate
support and collateral
(Hardware and Software)
The customer must have
a valid email address
(login)This web site also
allows you to track your
customers questions and
Q&A
NXP Confidential
IP Camera – March 2012
30
Key differentiators of NXP’s solution



Very low power consumption (0.65W for 720p/30, <1W for 1080p/30)

Dedicated hardware for compression and video processing

versus power hungry DSP implementation (like TI)
Excellent H.264 encoding capability

Higher video quality

Bitrate factor 2 to 3 lower  e.g. 2 Mb/s @ 1080p/30 !
Support of encoding substream

720p/30 & D1/30 (ASC8848)

1080p/30 & 720p/30 (ASC8851)

Support of SVC-T & ROI

Very high video processing/enhancement capability

NXP supports a very wide range of sensors

And provides customer/application specific tuning service/training

Digital Video Input and Output at 1080p/60

ONVIF Compliant

DDR3 support (versus DDR2 for some competition)

Complete pin-to-pin product family to support all 720p/30  1080p/60

Comes with complete software kit providing high level API for fast TTM at low R&D effort
NXP Confidential
IP Camera – March 2012
31
NXP Confidential
IP Camera – March 2012
32