Monthly Report
Research Project Title:
Coding and Analysis Subsystems of Distributed Video Sensors
Theme: SIGGSP
PI: Prof. Shao-Yi Chien (Graduate Institute of Electronics Engineering, National Taiwan
University)
Co-PI: Dr. Chia-han Lee (Research Center for Information Technology Innovation,
Academic Sinica)
Sponsor Technical Champions: Dr. V Srinivasa Somayazulu and Dr. YK Chen
1. Team Members
Name
Classification
Note
Pin-Hong Kuo
PhD student
Chester Liu
Master Research Assistant
Leave
Shun-Hsing Ou
Master student
Graduate
Yueh-Ying Lee
Master student
Pei-Heng Hung
Master student
Meng-Ting Zhong
Master student
New
2. Discussion with Champions
a. How many times?
2 (6/25, 7/10)
b. What are the major comments/conclusion from the discussion
Discussion about the F2F meeting in Aug.
3. Progress between Last Month and This Month
a. Summary of key findings and innovation
Major Accomplishments of This Half Year
1) On-line multi-view video summary system on distributed video sensors: Based
on the context modeling technique with Gaussian Mixture Model (GMM), an
on-line multi-view video summary algorithm is proposed. It has intra-sensor
and inter-sensor processing stages. In the intra-stage, redundant background
videos can be removed in each sensor; in the inter-stage, redundant videos
among sensors can be further removed. Experiments show that the proposed
method successfully reduces the video content while keeping important
events. It achieved nice precision-recall performance with low complexity and
memory resource requirements .
2) Prototype of video summary system on Raspberry Pi: Major accomplishments:
We also implemented the on-line video summary system on Raspberry Pi.
With the help of hardware-accelerated codec, the performance of 22fps can
bewas achieved.
3) Distributed video coding based on HEVC/H.265: Major accomplishments: The
effect of HEVC/H.265, the emerging video coding standard, on DVC is
investigated. The key frame channel is encoded with HEVC/H.265 instead of
H.264. The variable block size coding scheme of HEVC is also considered to be
employed in the Wyner-Ziv channel. Some preliminary experimental results
show that little coding gain can be achieved.
4) FPGA prototype for DVC SoC: Major accomplishments: For our developed
OpenDVC, an open-source DVC codec, we develop a System-on-Chip (SoC)
prototype on FPGA. This SoC includes a system controller, DVC codec, sensor
interface, and WiFi interface IPs, which are connected with AMBA AHB bus. It
is verified successfully on FPGA, where real-time performance is achieved.
Working Items of the Next Half Year
1) DVC codec: In the next half year, we will focus on multi-view and
multi-resolution DVC. By further investigation, we hope that we can further
enhance the capability and applications of DVC.
2) Prototype chip of DVC SoC: Based on the FPGA prototype of DVC SoC, we are
now working the chip tape-out process of DVC SoC. The Verilog RTL code still
needs to be modified before tape-out in order to meet a higher specification.
The target day of tape-out is Oct. or Jan. of 2015.
3) Object detection algorithm development: The DVA subsystem is composed of
two engines: frame engine and object engine. For the object engine, our plan
is to develop a universal object detection engine that can detect people
(pedestrian), car, and other vehicles. Among all these objects, people object is
the most important target. We are now in the stage of paper survey and
literature discussion.
4) Video summary: After Earl’s graduation, we will have one research assistant
working on this topic. He will start from the code and system Earl has
developed. We will first build a larger video sensor network for more data
collection and measurement. Our next plan is to develop video summary
applications for scenarios with high-density crowd. The other plan is to
develop an object-based video summary with the developed object engine.
b. Negative results and their consequences
N/A
c. Cross-project synergy
We have several discussions with ICS team. The goal of our project is to find the
location, identification, and behavior of subjects in a smart home. Other than
human detection and behavior analysis. We think camera calibration may be an
important issue in our system to mitigate the barrier of deployment for end users.
We may need more information from other sensors.
4. Brief Plan for the Next Month
Continue these items:
1) DVC codec: Getting some conclusions for the HEVC based DVC.
2) Prototype chip of DVC SoC: Verilog RTL code freezing for the tape-out.
3) Object detection algorithm development: Paper survey and literature
discussion to define the scope of this part.
4) Video summary: Building a larger video sensor network for more data
collection and measurement.
5. Research Byproducts
a. Paper submissions, or acceptance
Shun-Hsing Ou, Yu-Chen Lu, Jui-Pin Wang, Shao-Yi Chien, Shou-De Lin, Mi-Yen Yeh,
Chia-Han Lee, Phillip B. Gibbons, V. Srinivasa Somayazulu, and Yen-Kuang Chen,
“Communication-efficient multi-view keyframe extraction in distributed video
sensors” accepted by Visual Communications and Image Processing 2014.
Shun-Hsing Ou, Chia-Han Lee, V. Srinivasa Somayazulu, Yen-Kuang Chen, and Shao-Yi
Chien, “On-line Multi-view Video Summarization for Wireless Video Sensor Network,”
accepted by IEEE Journal of Selected Topics in Signal Processing.
b. Talks (invitation received and given)
Tutorial speaker, 2014 IEEE M2M Summer School
論文
(1)
國際期刊
(2)
國際會議
Hsin-Fang Wu, Chia-Han Lee, V.S. Somayazulu, Yen-Kuang Chen, and Shao-Yi Chien,
"Error resilience for key frames in distributed video coding with rate-distortion
optimized mode decision," in Proc. 2014 IEEE International Symposium on Circuits
and Systems (ISCAS2014), pp. 1118--1121, June 2014, Melbourne, Australia.
Shun-Hsing Ou, Chia-Han Lee, V.S. Somayazulu, Yen-Kuang Chen, Shao-Yi Chien, "Low
complexity on-line video summarization with Gaussian mixture model based
clustering," in Proc. 2014 IEEE International Conference on Acoustics, Speech and
Signal Processing (ICASSP2014), pp. 1260--1264, May 2014, Florence, Italy.
(3)
國內期刊
(4)
國內會議
(5)
高引用篇數
2.
擔任國際期刊編輯委員
Associate Editor, IEEE Transactions on Circuits and Systems I
Associate Editor, IEEE Transactions on Circuits and Systems for Video Technology
Associate Editor, Circuits, Systems, and Signal Processing (CSSP) (Springer Journal)
3.
受邀演講
Tutorial speaker, 2014 IEEE M2M Summer School
4.
重要榮譽/獎項
N/A
國際期刊論文
請將上述資訊填寫於以下表格
主持人
已發表 已接受 Top
簡韶逸
1
1
國際會議論文
已發表 已接受 Top
2
國內會 高引用 邀請
議論文 論文
演講
受邀
訪問
演講
學者
重要榮譽
博士後
博士生 /獎項
Newsletter
研究