Eli Peli, M.Sc., O.D., FAAO Optometric Issues with Head-Mounted Displays This lecture introduces head-mounted displays (HMD) and the optometric consequences of their wide use. A thorough review is provided to enable the optometrist to respond to inquiries from patients and parents regarding the use of these devices. With the new emergence of HMDs as game devices and as personal communication devices (Google Glass) public attention to the impact of HMD is increasing. Much of the material is overlapping with the issues of 3D television and movies, another area of current interest. Side effects of HMD suggested or reported in Literature (Mon-Wiliams et al ,1993; Wilson, 1995; Howarth, 1995; Howarth 2011) Effect on visual system performance: Reduce acuity or stereo vision, Changes in phoria posture or fixation disparity. Strabismus Subjective reports of visual discomfort - asthenopia Physical discomfort: head, neck, back Disorientation, nausea, motion sickness, simulation sickness Lowered cognitive and psychomotor performance Long term effects including hallucinations, flashbacks and addiction Effects that were certainly found Effects presumed to result from known optical aspects of HMD Effects frequently reported in the media with no known supportive evidence Classification of HMDs Monocular vs. Binocular Bi-ocular Stereo See-through vs. Opaque Synthetic imagery (ie computer games, molecules, models) Photographic imagery (tele-presence, robotics, endoscopy, LVES) Augmented reality – use in industry, medicine, and low vision Optometric issues (Peli, 1990; Peli 1995; Peli 1998; Fortuin, 2010) Instrument myopia Convergence and accommodation Real world situation Convergence demand and accommodation demand The demand line as function of IPD Single clear binocular vision - meeting both demand Misalignment of convergence and accommodation in HMD Static misalignment - hardware and optical considerations (Mon-Wiliams et al 1993) Various designs and their effects Dynamic misalignment - software - game considerations Unavoidable Software design guidelines Proposed solutions for the misalignment of convergence and accommodation Accommodative effect of stereo displays Monocular occlusion in children The critical period. Effects of intermittent occlusion on children's vision Monocular occlusion in adults Visual Perceptual issues Head motion, vestibular effects, image motion, and motion sickness Vestibular mechanism Adaptation- vestibular ocular reflex (VOR) Effects of VOR in HMD Boom (static) system: Nintendo (Virtual boy) - no problem Adaptation With HMD Unequal demand for both eyes Monocular Conflicting demands See-through (Sony, Virtual I-O ) Eye movements and image motion Saccadic eye movements Intermittent display (flickering pulsating - relations to asthenopia) LED display (digital alarm clock, Private Eye (Peli, 1990) CRT - short persistence phosphors (Neary &Wilkins 1989) Fluorescent lighting Normal continuously illuminated scenes Saccadic suppression (Matin, 1974) Image motion and eye movement changes Intermittent binocular displays Critical Flicker Frequency binocular in and out of phase In-phase 8% higher CFF than out of phase (Perrin 1954) Out of phase intermittent display reduces or eliminates jump (Chen 1993) Effects of low update rates Smooth pursuit eye movements Refresh rate (static imagery) Update rate (dynamic imagery) User response tracking Low update rate schemes (refresh rate double update rate) Present each updated frame twice - Bright Eye- low vision Double, low contrast images (Chen, 1993; Lindholm, 1992) Lower refresh rate to match update rate Noticeable flicker Binocular display, hybrid method. Binocular Rivalry effects in monocular HMD Two non similar images presented to both eyes. Unstable perception Alternating periods of monocular dominance Factors affecting rivalrous display Eye dominance in rivalry Sighting dominance Users with abnormal binocular vision Position of monocular HMD Bioptic (above line of sight) Bifocular (Below line of sight) (Katsuyama et al 1989) Design considerations Accommodation Fixed (Virtual I-O 4 meters, Optics 1 6 meters) with or without correcting lenses (effect of un-corrected hyperopia) Adjustable (Nintendo's Virtual-Boy, Sony's Visortron) with or without correcting lenses Convergence Fixed (Virtual I-O, Optics 1) Adjustable (Sony's Visortron) Convergence in relation to focus setting IPD Fixed (Virtual I-O) Adjustable (Sony's Visortron, Nintendo, Optics 1, PT- 01) Prismatic effect Field curvature No negative focus. Magnifiers up to 2 diopters (Katz, & Zikos, 1994) Does not represent problem for young accommodating users. Field curvature disparity between eyes. Require change of accommodation as the gaze is moved across the screen. If user's IPD does not match that of the system Tolerances for Quality Control No Standard exist yet. Relation ANSI Z80.1-1972 standard for spectacles Vertical alignment Shift in vertical alignment as a result of direction of gaze Horizontal Alignment Magnification, Aniseikonia Aniso-accommodation Cyclotorsion. Product Liability Age of maturity Testing of various devices (Peli, 1990; Peli, 1998) References Chen J. -S.(1993) A study of the effects of low update rate on visual display. SID 93 Digest; 510-513. Fischer RE. Optics for head mounted displays Information display 7&8: 12-16, 1994. Fortuin, M. F., Lambooij, M. T., IJsselsteijn, W. A., Heynderickx, I., Edgar, D. F., and Evans, B. J.W. (2010). “An exploration of the initial effects of stereoscopic displays on optometric parameters.” Ophthalmic and Physiological Optics, 31, 3344. Goss AD Ocular Accommodation, Convergence, and Fixation Disparity: A Manual of Clinical Analysis. Butterworth-Heinemann, Boston, 1986 Howarth PA "Visual effects of immersion in virtual environments: interim results from the UK health and safety executive study. Presented at the Annual meeting of the American Academy of Optometry, New Orleans LA (1995) Howarth, P. A. (2011). “Potential hazards of viewing 3-D stereoscopic television, cinema and computer games: A review.” Ophthalmic and Physiological Optics, 31, 111122. Hughes R.L. , LR. Chason, and J.C.H. Schwank, "Psychological considerations in the design of helmet-mounted displays and sights: Overview and annotated bibliography," in Aerospace Medical Research Laboratory AMRL-TR-73-16, by National Technical Information Service and U.S. Dept. of Commerce, Washington, D.C., U.S. Government Printing Office (1973). Katsuyama R.M., D.L. Monk, and E.P. Rolek, "Effects of visual display separation upon primary and secondary task performances," Air Force Aerospace Med. Res. Lab., Tech. Rept. AAMRL-TR-89-018, Wright Patterson AFB, Ohio (1989). Katz, M. & Zikos, G. (1994). Apparent image quality of magnifiers depends on amplitude of accommodation. Optometry and Vision Science, 71, 226-234. Lambooij, M., Fortuin, M. F., IJsselsteijn, W. A., Evans, B. J. W., and Heynderickx, I. (2011). “Susceptibility to visual discomfort of 3-D displays by visual performance measures.” IEEE Transactions on Circuits and Systems for Video Technology, 21(12), pp. 1913-1923. Lindholm J. M. Perceptual Effects of Spatiotemporal Sampling in Karim M. A. Editor Electro-Optical Displays. Marcel Dekker, New York, 787-808 (1992) Luo G, Rensing N, Weststrate E, Peli E. (2005) Registration of an on-axis see-through headmounted display and camera system. Optical Engineering 44(2), 024002. Matin E. , "Saccadic suppression: a review and an analysis," Psychol. Bull. 81, 899-917 (1974). Mon-Williams, M., J.P. Wann, and S. Rushton (1993) "Binocular vision in a virtual world: visual deficit following the wearing of a head-mounted display," Ophthalmic and Physiological Optics 13(4), 387-91 Neary C. and A.J. Wilkins, (1989) "Effects of phosphor persistence of perception and the control of eye movements," Perception 18; 257-264. Neveu, P., Priot, A.-E., Plantier, J., and Roumes, C. (2010). “Short exposure to telestereo affects the oculomotor system.” Ophthalmic and Physiological Optics, 30, pp. 806-815. Peli E (1990). Visual issues in the use of a head mounted monocular display. Optical Engineering, 29:883-892. Peli E. (1995) Real vision and virtual reality (invited paper). Optics and Photonics News. July ; 28-34. Peli E. The visual effects of head-mounted-display (HMD) are not distinguishable from those of desk-top computer display. Vision Research, 1998, 38: 2053-2066 Peli E. (1999) Simple 1-D image enhancement for head-mounted low vision aid. Visual Impairment Research 1(1):3-10. Perrin FH A study of binocular flicker J Opt Soc Am 44; 60-69 (1954) Shibata, T., Kim, J., Hoffman, D. M., and Banks, M. S. (2011). “The zone of comfort: Predicting visual discomfort with stereo displays.” Journal of Vision, 11(8), 1-29. Wilson JR, Nichols S and Ramsey A (1995) Virtual reality health and safety : facts, speculation and myths. VR News, Vol 4(9), 20-24. Woods RL, Fetchenheuer I, Vargas-Martin F, Peli E. (2003) The impact of nonimmersive HMDs on the visual field. J Soc Information Display 11(1): 191-198.