利用英特尔凌动TME6XX处理器 开发嵌入式媒体处理应用 英特尔嵌入互联解决方案实验室 张宇 2011年7月 议程 • 英特尔凌动 E6XX处理器介绍 TM • 利用英特尔凌动TME6XX处理器开发视频编解码应用 • 利用英特尔凌动TME6XX处理器开发视频分析应用 • 总结 主流计算 深度嵌入计算 新平台架构 – 英特尔凌动™ E6xx 处理器 2008 2011 Intel® Atom™ Z5xx Intel® Atom™ E6xx INTEGRATION Processor Core IMPROVED FSB FEATURE SET FSB Memory Controller Display Controller PCIe PCIe FSB US15W Graphics & Video Processor Core Memory OPEN Controller STANDARDS Graphics & Video Display Controller IOH PCIe SDIO PCIe* Audio SDIO LPC PATA USB FLEXIBILITY Audio USB SATA GbE LPC PCIe = PCI Express* Technology 面向高度细分的嵌入式市场 Discrete SATA Example Uses Discrete USB Discrete GbE Intel® Atom™ E6xx Processor Display Controller Video Encode Graphics & Video Audio Processor Core Proprietary ASIC SPI/LPC Example Uses Existing Proprietary ASICs, e.g. Print Imaging, PLC Example Uses Memory Controller FPGA Diverse I/O Requirements e.g. Industrial Automation Network Interface s Low Spd Serial I/Fs HS Serial I/Fs Audio I/F Storage I/Fs PCIe 4 x1 Standard & Minimal I/O’s, e.g. IP Camera Accel. Clocks/ Timing Power / VR Video I/F Power Mgmt. Parallel Other I/F PCIe x2 IOH Interconne ct Fabric Enabling platform scalability Example Uses High Volume & Uniform I/O e.g. IVI, Media Phone, Connected Services Gateway 灵活性的优势 Intel® Atom™ Processor Z5xx LVDS SDVO FSB HD Audio LVDS SDVO Intel® SCH US15W USB SDIO PATA PCIe Video In Intel® Atom™ E6xx Processor Timberdale PCIe PCIe Video In I2S MOST IOH Bluetooth USB SDIO CAN SATA MOST Bluetooth I2S HD Audio e.g. 2010 IVI platform SPI Automotive Controller CAN e.g. 2008 In-VehicleInfotainment platform IO flexibility enables BOM optimization 英特尔凌动™处理器E6xx特点 CPU Core • 0.6GHz to 1.6GHz • 45 nm High K Process • Enhanced Intel SpeedStep® Technology • Intel® HT and Intel® VT-x enabled Video Engine • H/W accelerated video encode & decode • Encode format: MPEG4, H.264 • Decode format: MPEG2, MPEG4, VC1, WMV9, H.264 L2 Cache CPU Core L2 Cache • 24K Data Cache, 32K Instruction Cache • 512KB L2 Cache Hardware Video Acceleration 2D/3D Graphics Integrated Graphics Memory Controller Display Controller HD Audio SPI LPC GPIO SMBus Memory Support • • • • DDR2 800 MT/s 8 devices, up to 2GB 32-bit, Single Channel Memory down only • Up to 400MHz • Supports OpenGL* ES2.0, OpenVG* 1.1 • Runs Intel® Embedded Media Graphics Driver (EMGD) Dual Display • 24-bit single channel LVDS and SDVO PCI Express* Technology (PCIe) PCIe Intel® Hyper-Threading Technology (Intel® HT Technology) Intel® Virtualization Technology for IA-32, Intel® 64 and Intel® Architecture (Intel® VT-x) • 4 ports, each x1 only • Interface to IOH or any PCIe devices E6XX处理器的不同型号 Commercial Temperature (0 to 70C) Industrial Temperature (-40 to 85C) Core Frequency (GHz) Graphics Frequency (MHz) Video Encode Estimated Thermal Design Power (W) E680 E680T 1.6 400 Yes 3.9 E660 E660T 1.3 400 Yes 3.3 E640 E640T 1.0 320 Yes 3.3 E620 E620T 0.6 320 No 2.7 Category CPU CPU CPU CPU CPU CPU CPU CPU IOH Product Code CT80618007035AA CT80618003201AA CT80618005841AA CT80618005844AA CT80618007035AB CT80618003201AB CT80618005841AB CT80618005844AB CS82TPCF Ordering Information S-SPEC MM# External Name 909841 Intel® Atom™ Processor E680 905523 Intel® Atom™ Processor E660 905528 Intel® Atom™ Processor E640 905531 Intel® Atom™ Processor E620 909839 Intel® Atom™ Processor E680T 905804 Intel® Atom™ Processor E660T 905805 Intel® Atom™ Processor E640T 905806 Intel® Atom™ Processor E620T 908138 Intel® Platform Controller Hub EG20T 英特尔平台控制器中枢EG20T to Intel® Atom™ Processor E6xx PCIe 1 x1 USB2.0 SATA v2 SD/SDIO/MMC 2-port GbE MAC 6 host, 1 client GPIO 12-pin UART 4-port SPI 1-port 2-port 1 GMII/RGMII IEEE1588 CAN 1-port I2C 1-port Device Drivers available for the following OS Microsoft* Windows* XP SP3 Microsoft Windows Embedded Standard 2009 Microsoft Windows Embedded POSReady Microsoft Windows 7/Windows Embedded 7 Microsoft Windows CE6.0 R3 Linux* Meego* 1.0 Fedora* 11 QNX Neutrino* VxWorks* 市场上已发布的IOH ML7213 ML7223 RTL8954C Contact IOH vendors for details and product updates 议程 • 英特尔凌动TME6XX处理器介绍 • 利用英特尔凌动TME6XX处理器开发视频编解码应用 • 利用英特尔凌动TME6XX处理器开发视频分析应用 • 总结 英特尔凌动™ E6XX系列处理器 – 高清视频解码性能 Format Profile Levels H.264 Baseline Profile L1,L1.2,L1.3,L2,L2.2,L3 H.264 Main Profile H.264 High Profile Max Resolution Max Frame Rate 480p 30 fps L1,L1.2,L1.3,L2,L2.2,L3,L3.1,L3.2, L4.1 1080p 720p 30 fps 60 fps L1,L1.2,L1.3,L2,L2.2,L3,L3.1 L3.2L, L4.1 1080p 30 fps MPEG-4 Simple Profile L0,L1,L2,L3 480p 30 fps MPEG-4 720p 30 fps 720p 30 fps DivX HD 1 3 MPEG-4 Advanced L0,L1,L2,L3,L5 Simple Profile 2 Max Bit Rate (Mbps) 45 8 VC-1 Simple Profile LL,ML CIF VC-1 Main Profile LL,ML,HL 1080p 30 fps VC-1 Advanced Profile L0,L1,L2,L3 1080p 30 fps 40 1080p 30 fps 20 1080p 30 fps 80 WMV9 Simple Profile LL,ML WMV9 Main Profile MPEG-2 Simple Profile Main Level MPEG-2 Main Profile LL,ML,HL Low, Main, High1440, High Level Fedora* 视频解码软件栈 Soft Audio Codec(s) MP3 AAC … Player/Codec Framework Container/ Source PS TS MP4 … System Level Components MPEG …. Elementary Audio Audio Decoder Raw Audio Video Processing Pipeline Raw Video Splitter/ Demux Elementary Video Bit-Stream H264 MPEG-4 MPEG-2 …. VAAPI* (Intel® EMGD) Intel® Hardware Intel® Embedded Media and Graphics Driver (Intel ® EMGD) Soft Video Codec(s) Theora* H263 H264 MPEG Hardware Video Codec(s) H264 MPEG -4 Part-2 VC-1 …. Gstreamer* http://www.gstreamer.net/ * 音视频插件 • Gstreamer* 音频插件示例 – FAAD/FAAD2. AAC 播放(GStreamer-bad plug-ins) – MAD. MP3 播放(GStreamer-ugly plug-ins) – FFMPEG-Plug-ins – ALSA. Audio output sink (GStreamer-base plug-ins) • Gstreamer 视频插件示例 – Theora*, H263. Soft Video Codec (GStreamer–base plug-ins) – MixVideoDecoder. VC-1, H264, WMV, MPEG-4, MPEG-2 Hardware accelerated codec (3rd party plug-in) – Ximagesink, XVimagesink. Video Output sink (GStreamer-base plug-ins) – MixVideoSink. Video Output sink (3rd party plug-in; Works with MixVideoDecoder) 视频加速API (VAAPI) VAAPI - http://www.freedesktop.org/wiki/Software/vaapi 将应 用和编解码器处理的不同类型的数据交给图形处理硬件单元进 行解码 英特尔嵌入式媒体图形驱动(Intel® EMGD) 英特尔嵌入式媒体图形驱动(Intel® EMGD) http://edc.intel.com/Software/Downloads/EMGD/ 连接英特尔 凌动™ E6XX系列处理器的显示/解码硬件与VAAPI 议程 • 英特尔凌动TME6XX处理器介绍 • 利用英特尔凌动TME6XX处理器开发视频编解码应用 • 利用英特尔凌动TME6XX处理器开发视频分析应用 • 总结 基于边缘计算的智能视频监控系统框图 边缘服务 传输 实时告警 集中后台处理 中央管理系统 (CMS) 和 存储服务器 传输媒介: 边缘服务器 GPRS 3G, 功能: 摄像机 智能处理, WiMax 视频分析, 卫星 异常事件检 测,视频编 码,坐标和 时间戳标记 远程客户 远程接入 事件处理 INTERNET 基于凌动™ 处理器的视频分析仪 A/D Fiber VA and Mark D/A on raw Video IP Network IP Encoder Camera Video Analyzer Control Center 议程 • 英特尔凌动TME6XX处理器介绍 • 利用英特尔凌动TME6XX处理器开发视频编解码应用 • 利用英特尔凌动TME6XX处理器开发视频分析应用 • 总结 英特尔新出版的书籍 "This is an essential guide to working with the Intel® Atom™ processors that should be read by anyone who wants to understand how to use the platform effectively. The book covers key concepts including power management, parallel applications, and machine virtualization, while providing a clear explanation of the system architecture and how to use it to its fullest advantage." - Paul Krzyzanowski, CTO, OpenPeak Inc. http://www.intel.com/intelpress/sum_ms2a.htm 总结 • 嵌入式市场是高度细分的市场。为满足不同应用的需求, 处理器设计要在集成性和灵活性间进行平衡。 • 英特尔凌动™ 处理器E6xx 系列是第一款专为嵌入式应用 设计的凌动™ 处理器。 • 除了高度集成化外,首次将PCI Express技术应用到处理器 与IOH间的接口。 • 可以从多种IOH中选出最适合你的IOH,或设计自己的IOH 。 • 英特尔凌动™ 处理器E6xx 系列的高度集成性和灵活性使 得设计智能的嵌入式互联设备更简单,更便捷。 Thanks