The Visualization Brazilian
Network
Bruno Feijó
VisionLab/PUC-Rio
Some Pioneer Results – Brazil
Computing
Broadcast Production
Electronic Systems: Banking, Voting
Software Engineering (LUA, Agents, ...)
Visualization in early 80’s: TV Globo
Computer Graphics in the Broadcast Industry
Developments with a Spin-off: PDI
First in Television Drama Technology
First to use 1-inch videotape in outdoor shootings
Partnership with Sony
First Outdoor Blue Screen (early 90’s)
The Concept Of Visualization
It is more than data visualization and
Virtual Reality applications
Visualization as visual simulation of
processes and environments with a
technological basis shared by several
strategic sectors
Game = cinema = TV = simulator = …
Strategic Macrosector
Digital Content Production, Broadcast,
Cinema, Oil, Games, Defense, …
Visualization
Future scenario
Computational Holography
Entertainment, Defense, Communication, Education
Artificial Intelligence
Ultra-Definition (4K, 8K, …)
Water
The Connection Point
A single point with information, education,
entertainment, communication, and services –
...visual
Visualization Brazilian Network
RBV
Strategic development policy – Minister of
Science and Technology
A network of intelligence connecting
industry and academy
Research, Development and Innovation
Goals: To organize the visualization
sector and to promote innovation in
order to increase competitiveness
Structured by competences
RBV
Current Competences
Strategic Kernel – RBV JPessoa
Digital Production Pole of Olinda
Pole of Games - PortoDigital
1
PE: [1] Games and Simulation (UFPE)
4
3
2 Rio: [2] Broadcast and Digital Content Prodution (PUC-Rio)
[3] Energy, Gas, and Oil (UFRJ)
5
SP:
[4] Industrial (USP)
RG: [5] Security and Defense (PUC-RS)
Rio
Lamce/UFRJ
VisionLab/PUC-Rio
UFRJ
Technological
Park
(under construction)
Pole Rio Cine&Video
University Lab aligned
With R&D&I&Business
Economic Cluster (Pole)
The Model Of Regional Integrated Axis
Strategic
Kernels:
clusters of
intelligence
executing National
Strategic Projects
Government
Sectors
Global projects
involving more than
one Competence and
having economic
feasibility
Specific Project:
Isolated project
belonging to a
Competence
Strategic
firms
Incubators
R&D Lab
(University)
Cluster of Production
and Business
P&D
Market
R&D
Training
Services
New Products
Pilot Axis
VisionLab-PoleRio
Key Concepts:
- Local Productive Clusters
- Strategic firms
- Logistics
- Resource equalization
- Management uniformity
- First organizing, financing later
National
Development
Bank
Mechanism for
Economic Feasibility
Sub-network
(capilarity)
National
Strategic
Projects:
International
organisms
Studios to rent
Clusters and Motion Capture
Offices for resource allocation
Production system support
Representatives of agencies
for development
Infrastructure for technical
support
Digital Production Commission
Conection to other networks and groups of
excellence through inductions or projects
in consortium
VisionLab/Pole Rio
VisionLab
VisionLab
Pole Rio Cine&Video
Firms
( 100)
Campus PUC-Rio, Gávea
Studios
&
VisionLab
Business
Center
Studios
Expansion Area
VisionLab
R&D And Innovation In RBV
Emerging and developing country
Low- cost high technology
Simplicity
Cross-functional development
Between sectors or companies
Focus on processes
Secrecy versus patent
Secrecy, short life cycle, and steps ahead
Research papers and product documentation
VisionLab R&D&I
Reconstruction and Simulation
Reconstruction and Simulation
Special Effects
3x cheaper and 2x faster
Realistic Simulation through time
VisionLab for BAND/NBP/RTP (Portugal)
Acident Simulation for TV Drama (3D models + image)
VisionLab for NBP/RTP (Portugal)
3D model
Low Cost Touch Screen Interface
camera
Low cost
High speed
High accuracy
No sound sensors
Array of infrared LEDs
projector
acrylic
plastic film
Platform:
Windows Media Encoder
.Net
IPTV Experiments
Active Objects
Simultaneous Broadcasting
- digital TV
- internet
http://www.shoptime.com.br/apollo/internetTV.do
Interactive Digital TV
PUC-Rio model
Screen Layout for Digital TV
Text
Status
Application
(VisionLab)
Middleware
(NCL/Telemidia)
Menu
Standard
Traffic
Main Text
Interactivity icon
Watermark
Interactivity icon
Wheather
Low-Cost Digital Asset Management
(in the compressed domain)
HW And SW For HD Stereo Projection
VisionLab
Absolute Technologies
The most compact 2K stereo projection system in Brazil
VLab Stereo Player
- 2K (High Definition)
- no flicking
- no audio dependence
High Definition Stereo
Production
Image-based Rendering for Games &
Simulations
Conventional 3D model
Relief impostor
(an image in real time)
Shading model
CPU-GPU Parallel
Architecture
3D Game Engines, Experimental
Games, and Mobile Games
Multiplayer Online
Game in Mobile
Phones
Storytelling for Interactive TV
and Defense
Current
scene
•
•
•
•
The plot has a logical structure. Scenes are predicates
with pre e post-conditions, e.g.: attack(draco,
princess_castle). Red scenes should wait and green
scenes are free to connect.
Automatic animation of the attack scene,
corresponding to the predicate attack
There are variations, but the backbone of the plot is not destroyed
There are both global visions and local/individual visions of the plot
The characters are intelligents, but fuzzy and emotional – this is Affective
Computing in Participative Games
Dramatic Gaming vs Action Game
Emotional Talking Heads
VisionLab
TeleMídia
IMPA
E7
terror
Facial animation
Emotion Model
Virtual Narrator
E6
admiration
astonishment
E8
fear
timidity
trust
uncertainty
surprise
acceptance
delight
grief
gloominess
extasy
sadness
joy
E5
E1
interest
boredom
0.5
annoyance
disgust
loathing
anticipation
vigilance
anger
fury
E2
E4
E3
1.0
Image-based shading for 2D
Animation
D- Digitalization
T- Thinning
Ch- Chain code
N- Normal vectors
Preprocessing
Shading
O- Outside vectors
S- Smoothing
F- Flood fill
I- Interpolation
C- Contour
Tracking
Pipeline for the Preprocessing Module
VisionLab
IMPA
Shading Example
Compression for Irregular
Meshes
Two vectors of integers only (V and M)
3D Bunny with 9672 triangles
compressed with the CLERS code
(red for C, dark blue for L, green for
E, yellow for R, and light blue for S)
C – create; L – left; E – end; R –
right; S – split
CHalfEdge Structure
VisionLab
Mechanics Dept.
Mathematics Dept.
Example:
CCCCcRsLcRCCcRsLEsLRLRE
Microsoft Research
Faculty Summit 2007