B.M.S COLLEGE OF ENGINEERING (An Autonomous College under VTU, Belagavi) Bull Temple Road, Bengaluru - 560 019 Technical Seminar-1 (20ECVESR01) on THE SOLI CHIP MASTER OF TECHNOLOGY In VLSI DESIGN AND EMBEDDED SYSTEM Adithya Reddy M V [ 1BM20LVS01 ] DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING 2021-22 WHAT IS SOLI CHIP? • A purpose-built chip to track motion on a microscopic scale • A system for real-time motion tracking of the human hand • It's able to track sub-millimeter motion at high speeds with great accuracy 2 WHO MAKES SOLI? • Google's ATAP (Advanced Technology and Projects) division has been developing the technology, which can be used in wearables, phones, computers, cars and IoT devices 3 WHAT CAN WE DO WITH SOLI? • Browse through music tracks, play, pause and change the volume 4 WHAT CAN WE DO WITH SOLI? • Draw or paint using your fingers without touching the screen • Navigate through maps 5 WHAT CAN WE DO WITH SOLI? • Rotate a dial • Move a horizontal scroll bar • Click a button ON/OFF 6 WHAT CAN WE DO WITH SOLI? • Vertical and horizontal scrolling just like on a touch screen. • Other gestures 7 LITERATURE SURVEY 1. SOLI : A Tiny Device for a New Human Machine Interface (IEEE – 2021) 2. Short-Range Radar based Real-Time Hand Gesture Recognition Using LSTM Encoder (IEEE – 2019) 3. Soli: ubiquitous gesture sensing with millimeter wave radar (ACM – 2016) 8 HOW DOES SOLI WORK? • SOLI works on radar based gesture recognition system. • The system has a micro radar transmitter and receiver which tracks the motion of the hand. 9 SOLI SENSOR BLOCK DIAGRAM • FMCW type of RADAR • 60 GHz • 5 mm wavelength • 0.05 – 5m range • 160° field view 10 FRACTIONAL-N PLL Ref freq N o/p freq 19.68 MHz 122 2.40096 GHz 19.68 MHz 123 2.42064 GHz 19.68 MHz 122 + 51/492 2.403 GHz 11 PUSH-PUSH VCO 12 AN OVERVIEW OF GESTURE RECOGNITION SYSTEM 13 ADVANTAGES • Radar sensor – not affected by illumination – can sense even in occluded condition • Low power compared to optical cameras and does not need to be exposed to outside because of radar signal’s transmissivity • Captures very minute details of hand movement • Small in size, hence fits inside very small devices – thanks to VLSI CMOS and BiCMOS technologies which are ever shrinking • Thereby can enhance the user experience in wearables, mobile devices, TVs, smart homes, automotive infotainment systems 14 CHALLENGES & FUTURE WORK • In early stage of development • Work is required to address radar clutter, signal coupling, fading, interference • Machine learning in gesture recognition 15 REFERENCES 1. S. Trotta et al., "2.3 SOLI: A Tiny Device for a New Human Machine Interface," 2021 IEEE International Solid- State Circuits Conference (ISSCC), 2021, pp. 42-44, doi: 10.1109/ISSCC42613.2021.9365835 2. J. -W. Choi, S. -J. Ryu and J. -H. Kim, "Short-Range Radar Based Real-Time Hand Gesture Recognition Using LSTM Encoder," in IEEE Access, vol. 7, pp. 33610-33618, 2019, doi: 10.1109/ACCESS.2019.2903586. 3. https://www.pocket-lint.com/phones/news/google/134079-what-isgoogle-project-soli-and-will-it-forever-change-the-way-we-use-wearables 4. A Fully Integrated Dual-frequency Push-push VCO for 5.2 and 5.8 GHz Wireless Applications 5. http://ispg.ucsd.edu/wordpress/wp-content/uploads/2017/05/2003Tutorials-I.-Galton-Delta-Sigma-Fractional-N-Phase-Locked-Loops 6. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar - ACM Trans. Graph., Vol. 35, No. 4, Article 142, Publication Date: July 2016 16 THANK YOU! 17