Connected 3D Fashion
Experiences
Consultation Workshop - 19 January 2010, Brussels
Prof. Nadia Magnenat-Thalmann & Dr. Dimitris Protopsaltou
MIRALab – University of Geneva
thalmann@miralab.unige.ch
dimitris@miralab.unige.ch
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
MIRALab
 MIRALab was founded in 1989
at the University of Geneva
 MIRALab director :
 Prof. Nadia Magnenat-Thalmann
thalmann@miralab.unige.ch
 MIRALab team:
 8 post doc and senior researchers
 ~20 researchers and PhD students
 ~10 MSc students
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
Expertise of MIRALab
 A pluridisciplinary lab working on virtual human
simulation and virtual worlds
Facial animation
Collaborative virtual environments
User centric Multimedia
Motion capture
Virtual heritage
Medical simulation Mixed realities
Virtual clothing
Hair simulation
Personality and emotion simulation
Graphics standardization
Body animation
Web 3D
Multidevices platform (PDAs & cellphones)
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
The User-Centric approach in Fashion
 Connected 3D Fashion Experiences is about:
 Garments, Shoes, Jewellery and Hairstyle
 Collaborative
Design
MIRALab - www.miralab.ch
Where Research Means Creativity
 Virtual Try-On
University of Geneva
Connected 3D Fashion Experiences
5
Traditional Garment process
apparel concept
• feel and look
• fabrics
The EU textile and clothing
sector is one of the two biggest
players in the world market.
Represents 29% of the world
exports
prototyping
• single size
• use samples of fabric or
• fabric printed in-house
technical sketches
fabric specs
• structure, weaved, knitted
• colors and prints
• style and form
• color and shape composition
• pockets, embroidery, finishing
grading and fitting
2D patterns
• made by pattern developers
• based on technical sketches
• made by grading specialists
• house specific grading system
• grading heuristics
accessories
• buttons, zippers, laces
2D pattern making
• fabric cut optimization
• marker design
production
• in-house or outsourced
• cutting, sewing, finishing
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
6
Virtual Garment Design in Collaborative Environment
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
7
Virtual Garment Design in Collaborative Environment
• A new working paradigm
 A Collaborative Working Environment that supports people in their
individual and cooperative work.
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
8
Virtual Garment Design in Collaborative Environment
• Different level of navigation
 Local workspace (Individual
work)
Level 02
 Shared workspace
(cooperative work)
Level 01
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
9
User Centric “Virtual Try-On”
 VTO is an online application, allowing
anybody to try-on virtual garments
 For consumers
 Online shopping: “I like this garment, but how does
it look on my body and will it fit?”
 For designers
 Rapid prototyping/evaluation of a design in various
sizes and with various fabrics
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
10
Existing Virtual Try-On for consumers
2-Dimensional
images
• Synthetic models
• Garments overlaid on body
image
• Limited adjustment of body
3-Dimensional model
Photo-based approaches
• Free view of entire static 3D
model
• Images of real garments
• Garments are 3D Meshes
• No adjustment of body
• Garments deformed (skinned) to
body
• Fixed viewpoints
• Garments overlaid on bodies
• Fixed viewpoints
In general there is no animation, a very limited personalization of body
measurements and there is no physical simulation of the garments
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
11
The Virtual TryOn (VTO)
 Combines three different modules into a
single coherent application
Body sizing
• 23 Parameters
• Animation automatically
retargeted to new sizes
Garment sizing
• On-the-fly switching between
different sizes
• No new files needed
High quality simulation
• Highly accurate simulation
• Generates video output
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
12
Virtual Try-On for designers and consumers
the Zegna outfit
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
13
An example: Zegna outfit
 Garment Prototyping
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
Next possible Scenario…
Walking outside a display
window; you take a photo
of dressed mannequin
Entering a fashion store; you
take a photo of garment draped
in the hanger
You are using your phone
to customise a 3D garment
to fit your body size
You and your friends
experience real-time 3D
interactive virtual
dressed humans
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Attending a fashion show;
you take a photo of a model
walking on the catwalk
You evaluate how tight is a
garment style and how it
interacts with your body
skin.
Connected 3D Fashion Experiences
Future challenges 1
 Virtual fashion environments tightly coupled to the physical
world
 Enabled by context-aware wearable and mobile devices
 that will become “a viewfinder for our fashion style”
 Holistic and scalable “social shopping” platform for mobile
users
 Searches and retrieves pertinent 3D fashion styles with
integrated fit and comfort knowledge
 Multi-modal search of deformed 3D objects
 Deformable 3D garment recognition and retrieval based on
multi-modal (photos and/or sketches) search queries
 Realise the “extended fashion store” that enables mobile
and social shopping
 Seamless session migration enables personal mobility
 Allows the store-based services and content to follow the
consumer
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
Future challenges 2
 3D content workflow supporting mobile
environments
 Enable interoperable styles and personas to be shared
between various mobile devices and multiple connected
worlds
 Visualisation of large number of virtual objects
composed of large and complex data sets
 Body scans, deformation maps, motion capture, 3D
garments and virtual fabrics
 Real-time interaction protocol preserves the realtime interactive performance of users.
 A real-time interactive media flow protocol ensures:
 low latency, end-to-end peering capability, security and
scalability
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
Future challenges 3
 Robust and real time simulation
 GPU-optimised virtual prototyping tools
 automated 2D-to-3D design process and animation of 3D scanned
bodies
 Haptic interfaces, which convey a sense of touch,
 enabling users to “feel” the virtual 3D fabrics they are manipulating
 New models for online collaboration
 Collaborators can develop a simulation jointly in real time but they also
can contribute to the simulation at different times.
 Raise issues of ownership and trading of virtual garments as well as
privacy data protection and fair right of use.
 Social ad-hoc interaction platform can support “spontaneous
interactions” among users
 Share contents and users’ experiences
 Without trespassing privacy and as well as extend and enrich users’
social relationships with their interests and emotions.
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences
18
Thank you for your attention
Contact:
Dimitris Protopsaltou
Dimitris@miralab.unige.ch
Nadia Magnenat-Thalmann
thalmann@miralab.unige.ch
MIRALab - www.miralab.ch
Where Research Means Creativity
University of Geneva
Connected 3D Fashion Experiences