Imaging in difficult environments: The digital Ophthalmoscope and the potential creation of a low cost capillary imaging system Prof Peter Bryanston-Cross School of Engineering Rolls-Royce Trent 800 engine with serrated nozzle to reduce engine noise Time & Cost Method: Measurement: Data Resolution Processing: Deliverables: Processing: Each engine test costs £200k and is completed in 10days Inject 0.8 micron particles in to the 1500oC 300Km/hr flow Imaging of the particles 100 microns over 48 ‘stitched 200mmx200mm frames Stereo PIV (Particle Image Velocimetry) Complete velocity mapping of the exhaust in 3D in 3 hrs 3 months to process 10 Tbytes of data Optical Medical instrumentation As part of a feasibility project a survey was made as to the diagnostics medical practitioners use in the process of a typical consultation. Typical consultation 5-10 minutes reading patients notes Assess facial colouring, signs of a flush for example Discuss with the patient their symptoms Measure blood pressure Measure pulse Lack of Diagnostic Information No previous diagnostic history other than text No self monitoring information Some instruments considered too difficult to use 70% likely outcome : If thing do not change come back next week. 5% likely out come: referred to hospital or specialist. Existing Devices: ECG & Digital Stethoscope Electro Cardio Graph Cardio24 Existing Devices: Pulse Oximeter • Pulse oximetry provides estimates of arterial oxyhemoglobin saturation (SaO2) by utilizing selected wavelengths of light to noninvasively determine the saturation of oxyhemoglobin (SpO2) • Nonin OEM II module – RS232-connection – Bluetooth connection BYTE3 180 160 140 Finger clip 120 100 80 60 40 20 09:49:17 09:49:16 09:49:16 09:49:16 09:49:16 09:49:16 09:49:15 09:49:15 09:49:15 09:49:15 09:49:15 09:49:15 09:49:14 09:49:14 09:49:14 09:49:14 09:49:14 09:49:13 09:49:13 09:49:13 09:49:13 09:49:13 09:49:13 09:49:12 09:49:12 09:49:12 09:49:12 09:49:12 09:49:11 09:49:11 09:49:11 09:49:11 09:49:11 09:49:10 09:49:10 09:49:10 0 http://www.adinstruments.com/products/list.php?group=Transducers*and*Accessories&sectionurl=Pulse*Oximetry&testgroup=N Existing Devices: Pulse Oximeter 75 measurements per second BYTE 180 160 140 120 100 80 60 40 20 09:49:17 09:49:16 09:49:16 09:49:16 09:49:16 09:49:16 09:49:15 09:49:15 09:49:15 09:49:15 09:49:15 09:49:15 09:49:14 09:49:14 09:49:14 09:49:14 09:49:14 09:49:13 09:49:13 09:49:13 09:49:13 09:49:13 09:49:13 09:49:12 09:49:12 09:49:12 09:49:12 09:49:12 09:49:11 09:49:11 09:49:11 09:49:11 09:49:11 0 Movement BYTE3 250 200 150 BYTE3 100 50 10:02:13 10:02:13 10:02:12 10:02:12 10:02:11 10:02:10 10:02:10 10:02:09 10:02:09 10:02:08 10:02:07 10:02:07 10:02:06 10:02:06 10:02:05 10:02:04 10:02:04 10:02:03 10:02:02 0 10:02:02 5 CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK CHK 09:49:10 4 HR MSB HR LSB SpO2 REV * * * * SpO2-D SpO2 Slew SpO2 B-B * * E-HR MSB E-HR LSB E-SpO2 E-SpO2-D * * HR-D-MSB HR-D-LSB E-HR-D-MSB E-HR-D-LSB * * 10:02:01 3 PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH PLETH 09:49:10 2 STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS STATUS 09:49:10 1 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 BYTE3 TIME Hz 1/75 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Rest Combining Diagnostics ECG Stethoscope Pulse oximeter Will give real-time feedback on Heart condition Valve operation Chamber contraction Blood oxygenation Prof. Singer Contacted the Mathematics Group to Initiate a Research Programme in Vascular Mechanisms. From an instrumentation basis the questions was asked What type of measurements are being made What is required What type of instrument is used Do we have the relevant expertise Could a low cost portable diagnostic instrument with suitable resolution be developed and Would it have value . Microcirculation Capillaroscopy • • • • • Microcirculation Microcirculation plays a key role in tissue oxygenation Red blood cell (RBC) is the indicator of the oxygen delivery. It is widely used in clinical studies Capillaroscopy for analysing images of the microcirculation using spectrophotometry in order to compute a complete blood count (CBC) without removing blood from the body[1] Orthogonal polarization spectral (OPS) imaging Sidestream dark-field (SDF) imaging 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation OPS imaging Orthogonal Polarization Spectral (OPS) imaging [2] Cytocan-II by Cytometrics (1) Polarized light (548nm) (2) Depolarized scattered light (3) CCD camera (4) Reflected polarized light is eliminated CytocanII 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation OPS imaging Advantages • • • Better clarity (than conventional reflectance imaging) Light wavelength (600–1100 nm) reduces scattering and absorption for tissues Clinical validated Disadvantages • • • Illumination scattering, blurring Contrast from reflected light Resolution 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation SDF imaging LEDs: 540±50 nm Vessels can be seen only if they contain RBCs, which appear dark Sidestream Dark-field (SDF) imaging[3] MicroScan Video Microscope by MicroVision Medical 14 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation Advantages • • • • SDF imaging Better clarity, sensitivity and resolution (than OPS) Fine-tune the depth of focus without moving the probe, thus without blurring portable operation Clinical validated Disadvantages • • Video frame rates at 750 pixels/sec (25 fps (PAL) or 30 fps (NTSC)) Resolution 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation Video output was visualized on a monitor and connected to a computer via a signal converter (Canopus, ADVC110) to directly and digitally record images onto a hard drive as DV-AVI files to enable off-line analysis of the images.[4] majority capillaries size (10 to 35 μm) 10 microns = 50lp/mm (line pairs per millimetre) resolution 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation RBC Velocity Determination • image registration and pre-processing • skeleton extraction • sketch the skeleton to estimate horizontal and vertical displacements • velocity of all the pixels 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation RBC Velocity Determination •A 45-second video of capillary blood flow •1350 continuous frames (30 fps) •The RBC velocity of 12 vessels (at 3 sites) Microcirculatory Analysis Software (MAS 2.0) •microcirculatory blood vessel diameters •RBC kinetics (Academic Medical Centre, University of Amsterdam). 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation • Conclusion • Available instrumentation exists which has adequate resolution However, • • There is the potential to create a low cost portable instrument. There is the potential to create a high resolution portable system • The resolution and design closely matches that developed for the digital ophthalmoscope. • The processing applied closely matches that used for processing aerodynamic research currently in progress • The Resolution and frame rate could be improved significantly • Advanced computer-aided image processing tools are avaiable • CMOS cameras to improve power consumption and resolution 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation References • • • • • [1] NADEAU RG, GRONER W: Orthogonal polarization spectral imaging: State of the Art. In: Orthogonal Polarization Spectral Imaging. MESSMER K (ed). Karger, Basel, Vol 24, pp 9-20. (2000) [2] Černý, V. TUREK, Z. PAŘÍZKOVÁ, R. Orthogonal Polarization Spectral Imaging. Physiological Research. Minireview. 56: p141-147, (2007). [3] Ince C. Sidestream dark field imaging: an improved technique to observe sublingual microcirculation. Critical Care 9 (Suppl 1): P72, (2005). [4]Goedhart PT, Khalilzada M, Bezemer R, Merza J, Ince C. Sidestream Dark Field (SDF) imaging: a novel stroboscopic LED ring– based imaging modality for clinical assessment of the microcirculation. Optics Express;15:15101-14. (2007). [5]Leahy, M, J. et al. Biophotonic methods in microcirculation imaging. Medical Laser Application, 22-2, p 105-126. (2007). 2009-2010 ES9P5 Remote Sensing and Data Processing Presentation