Relevant developments and initiatives in ICT Ats Prof.sa Licia SBATTELLA - Politecnico di Milano licia.sbattella@polimi.it Assistive Technology Group Politecnico di Milano Polo Regionale di Como AT Group : mission • Assistive Technology Group, the mission: Identify, forecast, implement, promote and apply innovative method and technology from ICT for the development of sustainable solutions for fragility (disabled, elderly, difficulties, …) and for digital inclusion which guarantees the recovery of functionality, social integration, equal opportunities, health, self determination and quality of life AT Group : mission • Assistive Technology Group, the mission: Life Project • People – Elderly and Disabled • Functions and bodily structures, activities and environmental factors • Research and development of systems and support devices • Create awareness Needs Projects • New solutions • Methods, systems, devices, processed Innovation Method - Technological AT Group : Skills • • • • • • • • • • • • • • Fabio Salice – Pervasive Systems Licia Sbattella – Sensory Cognitive, Natural Language Computation Andrea Bonarini – Robotics and Affective Computing Piero Fraternali – Data Base and WEB Technologies Matteo Matteucci – Artificial Intelligence, Pattern Recognition and Artificial Vision Sara Comai – Data Base Marco Tagliasacchi – Digital Signal Processing Thimoty Barbieri – Sensory Cognitive Matteo Cesana – Wireless RF Sara Rubinelli – Argumentation Theory and Persuasion Roberto Tedesco - Natural Language Computation, Assistive Devices Design Marzio Glauco Ghezzi – Educational Design Marzio Ghezzi – Project Manager Roberto De Paolis – Design and ethical design AT Group : Collaborations • Enterprises • Public Structures – Provincial, national e international • Organizations – Local, national e international • Politecnico – Polo Territoriale di Como is a competences center to support disabilities and innovative tools and devices for teaching and education Projects Assistive Technology Group Research group Activities Politecnico di Milano Polo Regionale di Como Engineering aspects • ICT (Information and Communication Technologies) – Computer Science, Computer Engineering and Telecommunications • Graphical applications • Communication techniques with low cognitive impacts – Augmentative and Alternative Communication (AAC) – Computational Linguistic (natural language processing) • Educative and formative actions Building Automation • Project: Autonomamente – www.autonomamenteinrete.it Consolidated Technology Existing Standard Open Source Software Applications for controls Applications for support Building Automation • Project: Autonomamente – www.autonomamenteinrete.it Monitoring example Light 1 Door Window Oven TV Building Automation • Project: Autonomamente – Assistive functions • Communications: Telephone, e-mails, sms • Domestic Economy: finance management • Agenda and Scheduling Manager – Time progress control and management • Casa Tranquilla (Calm Home): home state verification Auxiliary Supports • Project: Brain Computer Interface (BCI) – Computer Brain Controlled • P300 waves Auxiliary Supports • Project: Brain Computer Interface (BCI) – Brain Electrical Chair Control (LURCH) Vehicle Dynamics Motor Control Auxiliary Supports • Project: Brain Computer Interface (BCI) – Joystick Interface Development “Man in the middle” Auxiliary Supports • Project: Brain Computer Interface (BCI) – Example of Multimodal Interaction Room Selection kitchen living room bedroom bathroom Stimulation Feedback For ErrP Movement Command Pattern Recognition EBNeuro Galileo EEG system Auxiliary Supports • Project: Localization And Ubiquitous monitoRing of pAtients for health care support (LAURA) – Fine Grain wireless localization and biological parameters monitoring system • Intrusion detection • Conflict detection • Biological condition – Low cost system – Self-configurable – Self-tunable Innovations • Project: Van Gogh for Blind – Transformation of object depth into vibration Innovations • Project: Chemical education through haptic interaction • Design and implementation of a haptic system (i.e., providing force / tactile feedback) to model complex molecular interactions Sensable™ PHANTOM ® Innovations • Project: Campus Tools (CATS) project: multimodal access to lectures • Facilitate lip-reading for deaf or hard of hearing students • Video stream of lip movements • Audio • Captioning by ASR MULTICHANCE POLITEAM Innovations • Project: Campus Tools (CATS) project: multimodal access to lectures (cont.) • To facilitate notetaking • To mix slide objects and hand notes MULTICHANCE POLITEAM Innovations • Project: Natural Language Processing for learning and communicative impairments • • • • To improve accessibility of textual and vocal contents To support language learning and communication To analyse vocal and communicative skills To predict, correct, and support verbal and non verbal expression MULTICHANCE POLITEAM Innovations • Project: Advanced Applied Research: the UBICAMPUS • To navigate and explore a wireless campus • To obtain complete accessibility of global and local information (often changing daily) • To communicate with the other protagonists of the academic life • To handle emergencies and to be localized • To obtained personalized services based on a specific profile • To adopt innovative solutions for independent life MULTICHANCE POLITEAM Innovations • Project: LAMUSA : MultiModal Expression • Virtual Environments, Multimodal Communication and Artistic Production for kids and adults with Cognitive Disabilities and Autism MULTICHANCE POLITEAM Innovations • Project: The LAMUSA Project: a Symphonic Model for adult life! MULTICHANCE POLITEAM Project References • 4Wheels • licia.sbattella@polimi.it, luciano.baresi@polimi.it, matteo.matteucci@polimi.it, lorenzo.mosca@polimi.it • Autonoma-Mente • piero.fraternali@polimi.it, thimoty.barbieri@polimi.it • BCI-Speller • matteo.matteucci@polimi.it, licia.sbattella@polimi.it Project References • LURCH Project • andrea.boarini@polimi.it, matteo.matteucci@polimi.it • MultiChancePoliTeam • licia.sbattella@polimi.it , dafne.forloni@polimi.it , alessandra.nozza@polimi.it , paola.bravo@polimi.it , roberto.tedesco@polimi.it , silvia.sbattella@polimi.it • CATS Project • licia.sbattella@polimi.it, roberto.tedesco@polimi.it, elisabetta.genovese@unimore.it, roberta.garbo@unimib.it Project References • LAURA • matteo.cesana@polimi.it , marco.tagliasacchi@polimi.it, redondi@elet.polimi.it, borsani@elet.polimi.it, fabio.salice@polimi.it • NLP for Disability and LAMUSA • licia.sbattella@polimi.it , roberto.tedesco@polimi.it • www.esagramma.net • UBICAMPUS • licia.sbattella@polimi.it, roberto.tedesco@polimi.it, lorenzo.mosca@polimi.it, silvia.sbattella@polimi.it