UMR 5505 CNRS-INP-UPS-UT1
Pr Jean-Pierre JESSEL
jessel@irit.fr
http://www.irit.fr/
VORTEX
IRIT
• Created in January 1990 from 3 laboratories
• More than 220 faculty staff and researchers, 60 engineers,
30 administrative
• About 120 PhDs students (>30 PhDs each year)
• Teaching Computer Sciences: UPS, INP, UT1, UTM
– Master and Doctoral School " Computer Sciences & Telecom"
• Active presence in IT scientific communities
• Important industrial partnership
• 7 Departments
• Federative Projects
• Technologic plates-forms
November 2007
VORTEX
Research topics developed at IRIT
•Information analysis and
synthesis
–Image processing / analysis
–Image synthesis and Virtual
Reality
–Video
–Speech processing
–Signal Processing & Telecom
•Data indexing, retrieval and
storage
–Data retrieval / storage in large
/ distributed DB
• Dynamic optimisation for
parallel retrieval
–Multimedia indexation
November 2007
•Interaction, autonomy, dialogue,
collaboration
–Themes organisation in a
dialogue
–non-verbal/textual
communication
–Degraded dialogue and
communication
–Collaborative working
cooperation modelling
–Auto-adaptive systems and
empiric control
VORTEX
Research topics developed at IRIT
•Reasoning and decision
–common sense reasoning
–Space and time modelling
–Decision
–Explanation, dialogue and
evolution
•High performance computing
–Numerical linear algebra
–Grid computing
–Optimisation and control
–Asynchronous parallel
algorithms
November 2007
•Architecture, systems and
networks
–Architecture
–Real time systems
–Networks
–Embedded systems
•Safe software development
–Type theory and proof
assistance
–Parallel and distributed
systems engineering
–Software component
development
VORTEX
Research topics developed at IRIT
• Federated projects
• Technological platforms
–
–
–
–
–
PRETI: research and experimentation in information processing
RFIEC: information search and knowledge extraction
TLSE: grid computing
PREVI: virtual reality and interaction
HCI Usage Lab
• Joint Labs
– AUTODIAG (ACTIA-IRIT-LAAS)
– MIDI (EADS CRC-IRIT)
– AIRSYS (AIRBUS-IRIT-LAAS-ONERA)
November 2007
VORTEX
VORTEX : Visual Object : from Reality To EXpression
• VORTEX
– The topic : Visual Objects
• Real, virtual, mixed; 2D / 3D
• Concepts, models and tools
– Creation, capture, management, modification, enhancement /
augmentation, display, interaction, share / distribution
– Fundamentals topics:
• Image Synthesis, Virtual Reality, Computer Vision, Multimedia,
Augmented Reality
– 3 Pr, 13 Lecturers, 3 Engineers, 26 PhD students, Masters,
fellows
• Intervention in 3 specialised Masters (UPS, INP)
– Head: Jean-Pierre Jessel
November 2007
VORTEX
3 research axes
Procedural modelling
Constraints, optimisation
Acquisition, creation
and visualisation
Sensors, vision, …
Meshes, Points, …
RT rendering,
Realistic rendering, …
Medical Imagery and
Derivate applications
Large screen visualisation
Sketch based modelling
Registration for AR
Multimedia Compositing
November 2007
Artificial Life Behavioural
Simulation
Reproduction, co-evolution,
auto-organisation, adaptation
Memory, learning, …
Simulation, animation
Character animation
Motion capture / edition
Collaborative distributed simulation
Collaborative virtual
prototyping
Virtual / Augmented Reality
3D Interaction, Distributed multimedia
Interactive networked virtual and
augmented environments
VORTEX
Acquisition, creation and visualisation
• Modelling
– Geometry: meshes, points
• Subdivision: points, meshes
– Sketch based modelling
– Declarative: properties, constraints
• Rendering / visualisation
– Realistic rendering
• Physics Simulations
– RT rendering
• Software / Hardware
• Parallelism
– Clustering
– GPU
• Medical Imaging
November 2007
VORTEX
Acquisition, creation and visualisation
• Visual Objects of Interest
– Perceiving visual objects (and phenomena) of interest
• Omni directional sensors (static scenes)
– Automatic detection
• Multiples images (tracking / registration)
– Using Visual Objects of Interest
•
•
•
•
November 2007
3D reconstruction, registration
From visual objects to multimedia contents
From objects to flux
Composing VOI and using them (remotely)
VORTEX
Artificial Life and Behavioural Simulation
• Behavioural Simulation
– Character animation
• Motion capture / edition
• From Behaviour to motion
• Virtual storyboarding / storytelling
– Evolution, emergence, auto organisation,
memory, anticipation, collaboration
• Artificial Life
– Morphogenesis
– Multi criteria Optimisation
• Simulation for economy
and development
November 2007
VORTEX
Interactive networked
virtual and augmented environments
• Starting in 1992
• First step
– Immersion
– 3D Interaction
– DVR, collaborative VE
• Sharing DMU
November 2007
VORTEX
Interactive networked
virtual and augmented environments
• Virtual Reality
– Distributed Simulation
• Filtering
• Interoperability
– Coupling heterogeneous simulations
(HLA, CORBA, …)
– 3D Interaction
• Posture, Tangible interface, AR
November 2007
VORTEX
Interactive networked
virtual and augmented environments
• Augmented Reality
– Rigid tracking with occlusion
• Application to background tracking
• Visual contends composed
by real or virtual objects
– Non rigid tracking
• RT tracking of 2D meshes
– Fusion / registration
November 2007
VORTEX
Interactive networked
virtual and augmented environments
• Multimedia (distributed)
–
–
–
–
Contents (interactive) composed by objects
From objects to flux: distributed streaming
Heterogeneous run time environments (networks/terminals)
Multimedia content adaptation
– Interactive video: pedagogic contents for computer architecture
– JTMed: telemedicine plate-form (contract CNES)
November 2007
VORTEX
PREVI : a plate-form for VR and interaction
• Visualisation devices
– Large display
• Stereo retro projection
• Video projectors cluster (tiled display) / PC cluster
–
–
–
–
Auto stereo 42" screen
Stereoscopic goggles (active/passive)
Semi-immersive dome Elumens VS3
VR helmet Virtual Research
November 2007
VORTEX
PREVI : a plate-form for VR and interaction
• Interaction devices
– Data glove: Cyber Glove, 5DT
– Motion capture
• Ascension Motion Star (wireless), Polhemus
• Face tracker, Eye tracker*
– Force feed-back: PHANToM Premium 1.5A, Omni*
– Video tracking
November 2007
VORTEX
Collaborations
• National
• Local
– Computer Graphics French Association (Board)
– EuroGraphics France (Board)
– GDR Computer Graphics (Head)
– RTP Synthèse d’Images et Réalité Virtuelle
• Board, leader of research actions (rendering,
animation, …)
– EVASION, ACROE, LASMEA, CEREGE
•International
– STIC Asie "Réalité Virtuelle"
– Aachen (D), Calgary (Can), Cambridge (GB),
Stanford (USA)
– Algeria, Mexico, Vietnam,
Madagascar, Lebanon
November 2007
– IRIT
– ENSMAC, GREMAQ, IM,
LARA, LE, LEREPS, ONERA,
TTI, UTAH, LARA, LA
– MIDI, TéSa, FERIA
• Companies (including PhD):
– AIRBUS, CNES, C-S,
EADS CRC, GéoSignal, Groupe
Cecile (Magéllium, Pole Star,
Sodit), KYNOGON, OKTAL (SA,
SE), RENAULT …
–FittingBox and Onésia: startups hosted from June 2005 and
January 2006
VORTEX
Projects
• Past
– DIVERCITY, IMAGE, LUMIERE
• After CAVALCADE, CASH
• Virtual prototyping (collaborative), concurrent engineering
• Heterogeneous simulations interoperability
– Lighting simulation for A380 commercial cabin
– Lumière - RNTL (2004-2006), initiator
– DYNASPAT
• spatial simulation for economy (2005-07), leader
– SIGMA
• JTMed
– SIAMA, FOVEA
November 2007
VORTEX
Projects
•
Running
– National projects
• C6E2 - RNTL (2006-2008)
• NatSim - ARA MDMSA (2005-2008), leader
– Regional MP projects
• SITRA+Piéton (2006-08), leader
• SPATIALYSE (2006-08 , suite DYNASPAT)
• FILONAS (Firemen Intervention LOcation and NAvigation System)
– System dedicated to emergency services.
– Start-ups
• FittingBox and Onésia hosted from June 2005 and January 2006
– PREVI (VR and interaction Plate-form)
• Projects support
• Open to other laboratories and companies
– MIDI (Joint Laboratory EADS-CRC – IRIT)
• Collective visualisation
• Augmented Reality for mobile operator
November 2007