SMART CLOTHES FOR THE MONITORING IN REAL TIME AND CONDITIONS OF PHYSIOLOGICAL, EMOTIONAL AND SENSORIAL REACTIONS OF HUMAN F. Axisa1, A. Dittmar1, G. Delhomme1,. 1 Microcapteurs et Microsystèmes Biomédicaux, INSA Lyon, Bât. Léonard de Vinci, CNRS LPM, 20 Av. Einstein, 69621 Villeurbanne Cedex, France, Tel : +33 (0)4 72 43 89 86, Fax : + 33 (0)4 72 43 89 87, dittmar@univ-lyon1.fr Abstract- The world is becoming more and more "health conscious" and there is an important need for the improvement of the quality of health in medicine. Home care, ambulatory measurements, permanent monitoring are well-convenient for this purpose. For a citizen use, these devices have to be user-friendly. Smart clothes and gloves fit well for a citizen use due to their main characteristics: They avoid and/or they simplify the setting of sensors and they enable normal and daily activities. Marsian is composed of four elements: - A “smart tee shirt” (EKG, Rib cage and abdominal respiration measurement, Core temperature, body heat flow), - A “smart glove” (Skin potential and conductance, skin temperature), - A wrist device (amplification, wireless data transmission) - A data logger ( continuous recording) All the sensors are non invasive. Marsian can be used for the measurement of the autonomous nervous system activity, which provides information upon the emotional, sensorial,, intellectual and task reactions. The methodology has been already used for the study of the driver’s reactions in real conditions, for the study of smell, taste, touch and thermal comfort ( heat and air velocity) reaction, for sport activities, for the optimization for movement’s programming and mental imaging. the integration of sensors and actuators in the fabric frame and provide light and user—friendly electronic systems Fibres can also have an active role in sensing or communicating, as it self or in a network. Almost every kind of fibres can be woven or embroidered, like optic fibres, carbon fibres or polymer fibres. An example of technology is in Figure 1, are stainless steal wires woven in fabrics and used as bus in the VTAMN project [1] and Wealthy project [2]. Woven sensors, micro sensors and microsystems can be easily included in textiles due to their small size or their flexibility. I. INTRODUCTION 2) Smart Clothes and systems Smart bio communicative clothes and textiles will play an active role in ambulatory measurements and monitoring as a device itself. Communication can be provided by GPS, radio, screen, keyboard, camera, speaker or phone integrated in the cloth. Biomedical smart clothes use those facilities with a network of embedded sensors to measure and monitor non invasively the vital and behavioural parameters of human. MARSIAN is composed of a smart gloves and of atee-shirt which measure the activity of the autonomic nervous system to study physiological, emotional and sensorial parameters of human The World is becoming more and more ‘health conscious’, and expects from health care more and more security and efficiency. In hospital, the level of quality increases, new technologies provides more efficiency at cheapest cost, and sterility level is getting higher and higher. Moreover development of home care is a chance to increase the quality and the efficiency of health care. In order to reach such a goal, ambulatory measurement, monitoring devices, user-friendly devices, and non invasive and painless devices should be more and more developed. Textile is playing a great role in such development. At first, about 90% of the skin can be in contact with textile which is the main interface to body. Then fabrics are flexible and fit well with human body. Moreover fabrics are cheap and disposable. Last, integration of system into textile is now possible. 1) Integrated system in clothes and textiles Chemistry provides new fibres with new mechanical, optical, or electrical properties. Micro technologies enable Fig 1 : Stainless steal wires woven in fabric and used as bus for electronic system. II. METHODOLOGY This methodology provides a way to analyse emotional, vigilance and sensorial responses by measuring the physiological responses of the autonomic responses system. The autonomic nervous system (ANS) is a non conscious nervous system which control and feedback all the organs in order to adapt to the environment and obtain homeostasis. Two opposite subsystems can control all the organs: the sympathic and description of the intensity of the REDc responses. The diagramme in figure 5 is an algorithm which extracts from the intensity of the parameters variation the emotion due to the stimulation. This analysis should be done by expert system. ANS Responses Tonic Slope Slope duration Measurement methodology Fig 4: Example of pattern analysis for neurovegetative analysis: On the SC parameters, without stimulation, resistance is increasing with a regular slope that determines the tonic SC response. After stimulation resistance drops and came back to a regular slope after few oscillations. Duration of oscillations (DPO) is a description of the phasic response of REDc (A.Dittmar E.Vernet-Maury). SkinBloodFlow SkinResistance Skin Temperature Skin Potential Fig 2 : Electro dermal and thermo vascular non invasive sensors on the palm of the hand to measure the activity of the ANS. According to Ekman P., Levenson R., Friesen W.V [16], the ANS activity distinguishes among basics emotions, which are for Ekman anger, disgust, fear, sadness, surprise and joy. Each emotion has a specific ANS responses (Ekman, Levenson & Friesen, 1983; Levenson, Ekman & Friesen, 1990; Collet, VerneyMaury, Delhomme & Dittmar, 1997).The neurovegetative analysis is based on the variation of each of ANS parameters (SP, SC, SBF, ST, IHR, IRR). Those signals have significant patterns and variations which can be analyzed in order to extract emotional and sensorial information. Skin temperature Tonic Phasic SC in resitance parasympathic one. The sympathic system enable the body to react to emergency situation, increase heart beat, blood pressure, muscle irrigation, finger sweating . The parasympathic system is opposite and allow rest, heart beat decreasing, digestion. As all the organs are controlled by ANS and as skin is also an organ, we can get information upon ANS activity using non invasive skin sensors. Four skin physiological neurovegetative parameters are collected: Skin potential (SC), skin conductance (SC), skin temperature (ST) and skin blood flow (SBF) (using Hematron sensor), Instantaneous Respiration rate (IRR) ,movement of rib cage and abdomen using plethysmography, instantaneous heart rate (IHR) can also be monitored using non invasive sensors. 1min Skin Resistance + ++ ++ + ++ + + +++ Skin resistance Fig 3: ANS parameters variations for odour stimulation. SP and SC (here shown as skin resistance) modification are particularly visible. Just after the stimulation SC increase (Resistance decrease) as SP. Thermo vascular parameters have also typical reactions. Each parameter can be analysed in term of phasic and tonic response (fig 4). The phasic one is a response to stimulation and the tonic one is a response to a general state of mind, like vigilance or comfort. For each parameter we can extract indices which reflect the intensity of the responses: duration of oscillations is a DISGUST SADNESS FEAR SURPRISE + HAPPINESS ++ + -+ -+ + ++ + -+ +++ ++ + + Skin Potential + + Skin Blood Flow + + ++ Skin Temperature Fig 5 : Diagramme to extract emotion information from the variations and patterns of ANS parameters. It is used for the neurovegetative emotional analysis. neurovegetative analysis : Emotionnal response for odor stimuli % of emotion response Heart beat + + ANGER ++ ++ ++ Skin potential Skin blood flow ++ ++ ++ Heart Beat + + + Skin Temperature 80 70 60 50 40 30 20 10 0 Vanilla Menthol Eugenol Ang Dis Fea Sad Sur Joy quantitative Analysis according to Eckman Emotion System Figure 6: Emotional analysis result from neurovegetative analysis. Three odours were submitted to the subjects, vanilla, menthol and eugenol : Vanilla induce an emotion composed of about 80% of Joy and 20% of Surprise, but eugenol produces also Angry and Disgust. Menthol produces also Fear and Sadness This methodology has been already used to analyze reaction to odour, taste stimulus, to analyze vigilance in difficult tasks, to enhance mental imagery in sports activity. Figure 6 is neurovegetative emotional analysis of three odours. Neurovegetative emotional analysis provides a blueprint of odours and the impact of them on humans. integrates plethysmographics sensors for the rib cage and abdominal sensors, on which electrodes (woven stainless steal, silver electrodes,..) for EKG can be implemented. III. THE “MARSIAN” SYSTEM MARSIAN (Modular Autonomous Recorder System for the measurement of Autonomic Nervous system activity) is an ambulatory measurement and monitoring portable system designed for the evaluation of emotional and sensorial reactions, especially in case of thermal comfort and discomfort (figure 7). It is composed of four elements: - A smart glove which integrates skin sensors. - A smart shirt which integrates EKG electrodes and respiration sensors. - A wrist system which collects data, process them and provides a wireless communication system. - A data logger, or PC which records data and provides analysis algorithm. Fig 8 : Smart glove of MARSIAN with electrodes on palm view and connector on back view SENSORS AMPLI. Analog To Digital Micro Computer Wireless Transmission ANALYSIS Expert System Data Process Data collection Fig 9 : Structure of MARSIAN ((Modular Autonomous Recorder System for the measurement of Autonomic Nervous system activity) which grab signal from ANS Sensors and provide an analysis support for the experts. Fig 7 : MARSIAN Smart glove and wrist device. Smart glove and smart shirt use textiles with sensors and wires for communication, to provide userfriendly sensors setting, to enable the subject movement’s autonomy without spoiling monitoring and to ensure the ergonomic of the system. The smart glove (figure 8) is a cames glove with the less fabric possible to ensure mechanical function but not to interfere with the hand skin physiology. Electrodes Ag/AgCl (CLARK ELECTRODERMAL INSTRUMENTS, 30 mm²) are stuck to the fabric with silicon on finger location glue as well as a thermistance BETACurve10K3A1 on the palm. In order to have a interface gel, some solutions are still on research. Marsian includes non invasive skin sensors of skin temperature, skin blood flow, skin electrical conductance and skinl potential. Marsian includes also heart rate sensor and respiration sensors on a smart shirt. The smart shirt is a Visuresp™ tee-shirt (RBI,FRANCE) or a Wealthy shirt [2] or a Lifeshirt™ (Vivometrics,USA) which already Wrist device and data logger are designed to process, to record and to transmit data in a user-friendly way. Wireless communication and micro technologies are used to ensure a good ergonomic and autonomy of the system. The system doesn’t disturb the subject, and is well convenient to provide a ‘real image’ of the patient’s health. The wrist device is a motherboard which integrates power supply from Lithium battery, a low noise and low consumption amplification stage, an 18bit analog/digital converter, a microcontroller stage and an RF emission stage (Figure 9).. Fig 10 : Smart shirt from RBI, FRANCE, called Visuresp™, which includes plethysmographic sensors for rib cage and abdominal respiration Features of the wrist device are : data acquisition and treatment, cable or RF link with the data logger, several type power supply mode and event marker to enable real conditions experimentations. Last, the PC and data logger grab data and process them to record and enable analysis using an expert system. This software has a modular data treatment system to enable research in neuropsychological sciences. IV.CONCLUSION The autonomic nervous system activities (non conscious) in real and ambulatory conditions are related to the emotional, sensorial and cognitive responses and activities. Marsian is an hybrid device associating the advantages and the specificity of smart clothes and of wrist devices. Research is now focusing on smart clothes solutions to enhance the use and the reliability of sensors. Experimentation with MARSIAN has been already done. The results have the same quality than laboratory standard device already developed and tested by A.Dittmar and G.Delhomme (CNRS LPM, INSA Lyon, France). Ergonomic of the software has been also enhanced to enable user-friendly applications and experimentations. The non invasive multiparametric measurements carried out by Marsian have a large field of applications and researches. Main research topics are: Vigilance level and task related response (cognitive and physical), Response to odour, taste, touch, vision(shape, colour …), sound (speech …), Research on thermal and environmental comfort responses and states Comparison with conscious and verbal indications, Study in real conditions of the action programming in sport, Mental imagery training and study for sport Study of behaviour and stress. Moreover, in order to get an index or a decision tree to determine ANS response in thermal comfort, research are all also focused on subject responses in comfort or not in various temperature, humidity and air velocity conditions REFERENCES PROJECT : [1] VTAMN Project: "Bioclothes For ambulatory telemonitoring" (Vétement de Téléassistance Médicale Nomade), RNTS 2000, French Ministry of Research and new Technologies (France). [2] Wealthy Project: Wearable Health Care System, IST 2001 – 3778, Commission of the European Communities, http://www.wealthy-ist.com . [5] CNRS programme : "Smart Sensors, Clothes and Houses in Health", (Action Spécifique du Centre National de la Recherche Scientifique, 2002, France, "Capteurs, Vêtements et Habitats Intelligents en la Santé"). [6] RBI : Visuresp Device, rbi.sarl@wanadoo.fr, France BIBLIOGRAPHY : [7] Alaoui-Ismaïli O., Vernet-Maury E., Dittmar A., Delhomme G., Channel J. (1997) Odor hedonics: connexion with emtionnal response estimated by autonomic parameters. Chemical Senses, 2, 237-237 [8] Bloch S. (1965) Le contrôle centrale de l’activité électrodermale: etude neurophysiologique ete psychologique d’un indice sympatique de l’activité réticulaire. Journal of Physiology, 57, 1-132 [9] Collet C, Vernet-Maury E. Delhomme G., Dittmar A. (1997) Autonomic nervous system responses patterns specificity to basic emtions. Journal of Autonomic Nervous System, 62, 45-57 [10] Collet C., Roure R., Delhomme G. Dittmar A., Rada H., Vernet-Maury E. , Autonomic nervous system responses as performance indicators among volleyball players, (1999) Journal of applied physiology 80:41-51 [11] De Rossi D., Mazzoldi A., Dittmar A., Schwenzfeier L., Dressware: Smart fabrics and interactive clothing, IN: 4th workshop on multifunctionnal & smart polymer systems, Dublin, Ireland, 20-23 Sept 1999, 1p. [12] Dittmar A. Delhomme G., Axisa F., Les capteurs medicaux pour la télésurveillance, E-santé: Medecine de pointe, médecine de proximité, 2002, p91-97 [13] Dittmar A., Vernet-Maury E., Rada H., Collet C. Priez A., Delhomme G., Biométrie de l’activité émotionnelle et de la vigileance lors de conduite de véhicules, de process et de l’activité sportive par capteurs non-invasifs, Biom. Hum, Anthropol. 1997, Vol 15., 1-2, p45-53 [14] Dittmar A. (1989) Skin conductivity in cutaneous investigation. In J.L. Leveque (Ed.). Health and Disease (pp.323-358). New Yok : Marcel Dekker. [15] Dittmar A. Saumet J.L. Vernet-maury E. (1985). Apport des paramètres thermovasculaires dans l’analyse de la réponse électrodermale. Journal of physiology, 80, 22A. [16] Ekman P., Levenson R. Friessen W.V. (1983) Autonomic nervous system activity distinguishes among emotions. Science, 221, 1208-1210. [17] Robin O., Alaoui-Ismaïli O.,Dittmar A. Vernet-Maury E., Emotional responses evoked by dental odors : an evaluation from autonomic parameters, J. of Dent. Res., Aout 1998, Vol 77, No 8, p. 1638-1646. [18] Vernet-Maury E., Deschaumes-Molinaro C. Delhomme G. Dittmar A. (1991) The relation between bioelectrical and thermovascular skin parameters, I.T.B.M., 12, 98-1 [19] Vernet-Maury E., Dittmar A., Saumet J.L. Delhomme G. (1986) Le debit sanguin cutané, indice de la réactivité émotionnelle, Congrès de Neurosciences, Bordeaux [20] Vivometric: LiveShirt System, http://www.vivometric.com/, USA.