SavitribaiPhule Pune University INDEX Sr.no Table of content Page no 1. Introduction 1 2. Evolution 3 2.1 Volve 2.2 Mazda 2.3 Ford 2.4 Audi 2.5 Blind spot detection 3. Litrature Survey 5 4. Gap analysis 6 5. Project Objective 7 6. Future of blind spot detection system 9 7. Methodology 14 7.1 Hardware Development 8 9 Circuit Design of BSD system Referance B. E. (Mechanical Engineering) – 2019 Course 15 19 Page 1 SavitribaiPhule Pune University 1.Introduction Vehicle blind spot area depends on two main factorsthat is the heightof the driver and the vehicle size. This is very important as for driver with theheight below 1.6 meters;the blind spot area issubjected to increase Vehicle Blind Spot System is a system that isbuild to alert thedriver if there is anypotential collision object within the blindspot areaThe system comes with a microcontroller board and sensors.The data that arecollected from the sensors will determine whether theobject is a highrisk potential object ornotDriving a vehicle in modern trafficconditionsishighlyrisky. The high risk could occur if the driver watching the oncoming road hazards and at thesame time look backward in highways driving.It is essential to look both sideway and backward before safely change the lanes. A problem that often concerned by the driver isthe areas cannot be seen by side view and rear view mirrors,which is called as blind spot region of vehicle. In several accident cases it is happened because of a driver’s inability to monitor the blind spotsregion well.In Figure 1.1, the area almost commonly called to blind spot is the rear quarter blind spots, area towards the backof the vehicle on both sides. Vehicles in the adjacent lanes of the road may fall into these blind spots, and a driver may be unable to seeadjacent vehicleusing only the car's mirrors. Other areas that are sometimes called blind spots are those that are too low to see behind and in front of a vehicle. Also, in cases where side vision is hindered, areas to the left or right can become blind spots as well . B. E. (Mechanical Engineering) – 2019 Course Page 2 SavitribaiPhule Pune University 2.EVOLUTION 2.1 Volvo BLIS is an acronym for Blind Spot Information System, a system of protection developed by Volvo. Volvo's previous parent, Ford Motor Company, has since adapted the system to its Ford, Lincoln, and Mercury brands. This system was first introduced on the 2001 Volvo SCC concept car, then placed into production on the 2003 Volvo XC90 SUV and produced a visible alert when a car entered the blind spot while a driver was switching lanes, using cameras and radar sensors mounted on the door mirror housings to check the blind spot area for an impending collision. Volvo won an AutoCar Safety and Technology award for the introduction of this feature. Fig.1 Blind spot information system 2.2 Mazda Mazda was the first Japanese automaker to offer a blind spot monitor, which they referto as "BSM" (Blind Spot Monitoring). It was initially introduced on the 2008 Mazda CX-9 Grand Touring and remained limited to only that highest trim level through the 2012 model year. For 2013, BSM was standard on both the CX-9 Touring and Grand Touring models. Mazda also added BSM to the redesigned 2009 Mazda 6. Blind spot monitoring was standard equipment on the 6i and 6s Grand Touring trim levels, and was an available B. E. (Mechanical Engineering) – 2019 Course Page 3 SavitribaiPhule Pune University option on some lower trim levels. Mazda has since expanded the availability of BSM, having added it to the feature list of the Mazda2, Mazda3, CX-3, CX-5, MX-5 Miata, and the upcoming CX-30, often as part of an option package. 2.3Ford While only a concept car, the Ford GT90 was the first vehicle to be fitted with a modern blind spot monitoring system. Currently, Ford uses the acronym BLIS for its blind spot detection. The system is active both in "drive" and "neutral" transmission gears, and is turned off when in reverse or park gears.On Ford products, the system was first introduced in the spring of 2009, on the 2010 Ford Fusion and Fusion Hybrid, 2010 Mercury Milan and Milan Hybrid, and 2010 Lincoln MKZ. Ford vehicle also implement the same BLIS system that Volvo developed Ford vehicle places radarbased detectors near the rear of the car, but the light that flashes to warn driver of hidden vehicle is on the outside rear view mirror 2.4Audi Audi vehicle also introduced Audi Side Assist that will detect cars coming up from as far as 150 feet (45.7 meters) behind in adjoininglanes and flash a light in external rear view mirror 2.5 Blind spot detection Blind SpotDetection systems warns adriver that a vehicleis in his orher blindspot areas to the side andrear of the vehicleoutside the driver’s view.So thatthe accidents can beavoided .And dueto it changing oflanes will be easier and safely . B. E. (Mechanical Engineering) – 2019 Course Page 4 SavitribaiPhule Pune University Fig.2Blind spot monitoring system 3. Literature Survey The authors of proposed a blind spot monitoring system using the Histogram of Oriented Gradients (HOG) descriptor and SVM. The proposed algorithm introduces four main steps. Once an image frame is captured by a single rear-view camera, the first step is to set the detection window for vehicle detection in either the left or right blind spot area. The second step is to detect vehicles in the detection window using the HOG descriptor and SVM. The authors claimed that the HOG descriptor and SVM showed outstanding performance and reliability. The third step is to estimate the moving direction of the detected vehicles from the previous step. The last step is to generate an alarm signal if vehicles are in the blind spot area. Furthermore, a high-speed algorithm consisting of two additional concepts, i.e., selective filtering of the HOG features and fast estimation of moving direction, is introduced for real-time evaluation with an embedded system. The authors evaluated the developed algorithm with consideration of various environments and vehicles, and measured performance evaluation using recall and precision. The evaluation of the basic algorithm on both urban areas and highways resulted in 98.62% precision and 99.82% recall, respectively. When evaluating the B. E. (Mechanical Engineering) – 2019 Course Page 5 SavitribaiPhule Pune University high-speed algorithm, the authors reported 97.26% precision and 99.65% recall, respectively. In this network structure, there are four blocks after the first convolutional layer, and each block is designed by various combinations of the concepts based on the Visual Geometry Group (VGG), depthwise separable convolutions, residual learning, and the squeeze-and-excitation module. For this reason, four different neural networks are established: (i) only VGG blocks-based network; (ii) network with a combination of depthwise separable convolution and residual learning (Sep-Res) According to the literature research above, there are no doubts that the camera-based blind spot detection system has a potential possibility to be improved. However, some studies concentrate on proposing algorithms and techniques in conjunction with the methodologies of image processing and classification to detect moving vehicles in the blind spot. Besides, to the best of our knowledge, studies about blind spot detection using a Fully-Connected Network (FCN) only have not been reported. 4. Gap analysis Side view mirrors and rear view mirrorswas the early methodfor detecting blind spotsMirrors can help remove blind spots behinddriver , but theytypically leave largedead areas toboth sides of avehicle The addition of a convex blind spotmirror canallow adriver to see objectsthat fall into that type of blind spots ,but thoses imagesaredistorted and can makeit difficult to judge distances Due to the errors caused by humansin arranging the mirrorsand distorted images obtained by the convex mirrors leadsto a new technologycalled “BLIND SPOT DETECTION” In older days mirror was used in cars for rear view but for taking reverse ORVM (outer rear view mirror) are not sufficient . To overcome this IRVM (inside rear view mirror) are invented . If side view mirrors on a car are adjusted in a particular way, there is no blind spot on the sides. This method was first revealed by George Platzer in a 1995 paper presented to the Society of Automotive Engineers, but the method is frequently overlooked in driver's education classes and takes some getting used to. Calculated elimination of blind spots by trained drivers is inexpensive and obviates the need for expensive B. E. (Mechanical Engineering) – 2019 Course Page 6 SavitribaiPhule Pune University technological solutions to that problem, provided drivers take the time to set up and use their mirrors properly. Platzer received a patent for his blind spot monitor, and it has been incorporated into various products associated with Ford Motor Company. The blind zone mirror has been touted as "an elegant and relatively inexpensive solution" to this recognized problem. Fig.3 Side view of mirrors Fig.4.Lidar sensor 5.Project Objectives The objectives of this project are: 1.To design a portable and wirelessly controlled BSD system for lowend vehicle 2.To design suitable algorithm to calculate distance for detecting object when vehicle enter the blind spot region. 3.To design a hardware system for producing visible alert whenvehicle enter the blind spot region B. E. (Mechanical Engineering) – 2019 Course Page 7 SavitribaiPhule Pune University Problem Statement Nowadays, technology in vehicles has been rapidly increasing to reduce the risk of accident while driving vehicle. There are many research proposed based on the driving assistance system focusing on the blind spot regionThe modern technology based on sensors like camera, laser, ultrasonic and radar are most likely applies in highend and hightech vehicle to monitor blind spot region. Volvo vehicle was first introduced BLIS system that produced alert system if there any vehicle enter blind spot region. Volvo vehicle implement two door mounted lenses to check the blind spot area and functionally for driver to change lanes. After a decade, Volvo vehicle improve their BLIS system by using radarbased detector to monitor in blind spot region. Which the LED light on Apillarwill glow to detect the presence entity vehicle All of the highend hightech cars aremost likely to have embedded system of blindspot detection and these active blind spot detection systems are not available for low end vehicleThis blind spot detection system in highend vehicleis also remade act as driving assistance system for driver and implement intolowend vehicles. Howeverthe high productprice and installation cost and the capability of the product functional are the some of the factor which do not attract the low end users to use BLIS system. The driving assistance of blind spot detection or monitoring system for vehiclesis highly desirable to lowendvehicles to monitor 4blind spot region.So the research of blind spot detection system with high ratio of capability and more affordable price for lowend vehicle is an important task to reduce collision among vehicle. B. E. (Mechanical Engineering) – 2019 Course Page 8 SavitribaiPhule Pune University Fig.5. Range of sensor 6. Future of blind spot detection system Over the last few years, the growth was slow due to the high cost of safety systems and they were primarily installed in premium vehicles. However, in recent years the growing need for vehicle and passenger safety is making the installation of advanced safety systems a necessity in most vehicles. The growing stringency of government regulations pertaining to passenger and vehicle safety is also giving a significant boost to this market. APAC is anticipated to witness the fastest growth in the forecast period, owing to the growing demand in Japan, China, and India. Increasing sales of luxury vehicles and improving safety standards and measures taken by the government to reduce road accidents would continue driving the demand for blind spot detection in this region. This report Technology, Innovation and Market Report: Automotive Blind Spot Detection Solutions' provides an extensive analysis of technology perspective which is segmented based upon technology type, product type and vehicle type. This report also comprises of key insights from patent analysis of different companies and universities in this domain. Additionally, the report provides market-related insights including the key market trends, current and future market demand and the factors affecting the market along with a detailed competitive landscape. B. E. (Mechanical Engineering) – 2019 Course Page 9 SavitribaiPhule Pune University Continental, Denso, Robert Bosch, Delphi Automotive, and Autoliv are the leading players in global automotive blind spot detection solutions market. Other manufacturers include ZF Friedrichshafen, Magna, Denso and Valeo among various others. New product launches, innovations in technology, and collaboration with OEMs are the key strategies adopted by the key players to gain a competitive edge in the market. The advanced variant of blind spot detection works by using two corner radar sensors that are concealed in the rear bumper – one on the left, one on the right. These two sensors monitor the area alongside and behind the car. Powerful control software collates the sensor information to create a complete picture of all traffic in the area behind the vehicle. The rear corner radar sensors exceed the sensing range of the ultrasonic sensors. In contrast to the ultrasonic-based system, even fast-approaching vehicles can thus be detected at an early stage before a lane change Blind spot detection systems are currently only a recommendation of the Federal Ministry of Transport. Their installation is financially supported. But already in 2022 the situation will change. In 2022, a new European Union regulation will come into force requiring all new types of trucks to be equipped with a blind spot detection system. From 2024 this equipment will be required for each newly registered vehicle. 7.1.Project Scopes: They a several scopes of workhave been determined Areas follows: •BSD system that focusing quarter blind spot region vehicle. •BSD system is suitable apply for car, van and small lorry. The proposed system will use ultrasonic technology, hence some limitations are expected such as: •The detection angle is only 15deg, thus the sensor need to be located properly to cover the region of interest (BSR). Therefore a special toolneedsto be designed to fix the position of the sensors at certain angle. •The sensitivity of the sensors needsto be analyzed, as it may cause some delay in the detection process. Hence, an algorithm will be used to compensate this delay. B. E. (Mechanical Engineering) – 2019 Course Page 10 SavitribaiPhule Pune University 7.2.The invention ideas of BSD system The main purpose of invention ideas of BSD system mis tounderstand method used in previous research of blind spot monitoring system before applying tothis project. There are several ideas of invention that related to blind spot information system: A Wireless SensorBased Driving Assistant for Automobiles based on ultrasonic sensingIn this research paper, the system acts as a driving assistant for vehicles that detects the obstacle or object within the monitored area and alert the driver via tactile, audio and visual signalThisdriving assistant isbased on ultrasonic sensing approach. The system contains five separate components: four of them are the sensor modules and the fifth one is the controller. The nodes are connected in the sequel that attached to body of the car. Meanwhile, controller -responsible for coordinating the operation of the nodes and then process the data forpresenting alerts to the driver. The two front corners on both sides of the vehicle are covered by sensor modulesWhile the blind spot areas are the most likely ones to be neglected by drivers, the two front corners are found to produce the highest accident rates it shows the correlation among the system components. All five modesare makes around the same processing unit consisting of a microcontroller and radio transceiver.The sensor modules consist of ultrasonic sensors in the same time the controller connectedto three types of indicators such as LEDs panel, buzzer, and the vibrators mounted on the steering wheel . B. E. (Mechanical Engineering) – 2019 Course Page 11 SavitribaiPhule Pune University 6. Fig.6.Detection of blind spot 7.3 Ultrasonic sensor based blindspot detection system In thisresearch paper, the system based on proximity detection deviceisusingradio frequency waves for detecting object. It includes threepartsFront sensor, left sensor and right sensor The front sensor is functional to detect seasonal black spots. Thissensor will monitorpresence of any entity and warn the driver about the upcoming riskin cases of temporary blind spotit showsthe placement of sensor attach on body of the car. The left and right sensor will cover the blind spot at rear of car. The placement of sensor Fig.7.Ult rasonic sensors B. E. (Mechanical Engineering) – 2019 Course Page 12 SavitribaiPhule Pune University 7.4.LED meter The LED meter functional based on the sensor to alert the driver about entity object or possible risk. The LED meter was divided into three part activation. If the left sensor detect the object the left handside LED meter will be activated. While, if right sensor detect the object the right hand side LED meter will be triggered. Hence, the front hand side LED meter indicate risk of front sensor. The LED meter of this driving assistantThe concept of ultrasonic sensorUltrasonicsignals are like audible sound waves, except the frequencies are muchhigher. The ultrasonic transducers have piezoelectric crystals which resonate to apreferred frequency and convert electric energy into acoustic energy and vice versa. Fig.8. The LED meter of this driving assistant B. E. (Mechanical Engineering) – 2019 Course Page 13 SavitribaiPhule Pune University 8.Methodology 8.1. BSD system development BSD system is developed based on imitationand some improvements of previous worksdoneHardware and software development are two crucial parts needs to be consideredin this BSD systemThe hardware development is more on the components used, the designation of circuit and the real shape of BSD system. Meanwhile, the software development is based on how to program the brain (i.e. central processor) of the circuitryof wireless ultrasonic sensor and the circuitry of warning light indicator 8.2 Hardware development The project continues with the hardware development of BSD system.There are two major parsinthis hardware development of BSD system which are the circuitry ofwireless ultrasonic sensor and the circuitry ofwarning light indicator. Fig.9. System setup block diagram of BSD system B. E. (Mechanical Engineering) – 2019 Course Page 14 SavitribaiPhule Pune University Fig.10. System setup block diagram of BSD system for wireless ultrasonic sensorcircuit 8.3 Circuit design of BSD system Designing the circuit is the crucial part for this project. This isimportant due to the functional performance of the sensor dependson the quality of the designed. The Frizing and Eagle software have been used to design the circuit of circuitry for wireless ultrasonic sensor and circuitry for warning light indicator. it is the schematic diagram of the circuitryofwarning light indicator, design using Eagle software. After the design had been completed,the circuit is then tested on proto-board. Protoboard is used to implement the components that had been designed in circuit design step beforeimplementing it on the PCB or donut22board for soldering the components. This is important to know whether thesensor will be functioningas well as follow to the desired output of BSD systemor not. In this project, I had implemented the circuitry ofwirelessultrasonic sensor and the circuitry ofwarning light indicator first on the proto-board to test the functionality of both circuits. The circuitry of wireless ultrasonic sensor will detect the object or obstacles. B. E. (Mechanical Engineering) – 2019 Course Page 15 SavitribaiPhule Pune University After that, warning light indicator will respond the signal from the circuitry ofwireless ultrasonic sensor and activated the LED or buzzer insidethewarning light indicator. The programming will be discussed more on the software implementation. Fig.11. HC-SRO4 sensor Fig.12. Ultrasonic sensor Fig.13. The Arduino UNO B. E. (Mechanical Engineering) – 2019 Course Page 16 SavitribaiPhule Pune University 8.4Structure designand installation of BSD system This partwill mention about the installation of BSD system on the car. The shows the drawing of installation of BSD system on the car. Two parts ofthe circuitry ofwireless ultrasonic sensorare mounted on the left sideatthe flat surface of the car. Meanwhile, another two partsare mounted onthe right side atthe flat surface of the car. The detection of cars in the blind spot region isdisplayedby warning light indicators that hadbeen put on the dashboard of car Fig.14. The drawing of installation BSD system on the car. Arduino UNO and Arduino Promini Programming B. E. (Mechanical Engineering) – 2019 Course Page 17 SavitribaiPhule Pune University Arduino is an open-source physical computing platform based on a simple input/output (I/O) board and development environment that processing/wiring language.Both of Arduino UNO and Arduino implementsthe programming are the same. This isone of the advantages when using the Arduino as microcontroller.To program and upload the code into the ArduinoUNOand ArduinoProminimicrocontrollerit must beconnectedtoD the computer with a USB A/B cable. USB cableacts asa program connector between Arduino and computer. In ArduinoProminimicrocontroller used in the circuitry ofwireless ultrasonic sensor, the digitalpin D6 andD7have been setas the input of Ultrasonic sensor. Then, the digital pin D9 to D13 for activate NRF24L01 transmitter. The set of program code for thecircuitry ofwireless ultrasonic sensor was repeated for the preparation of another three sets. For the Arduino UNOmicrocontroller used inthe circuitry ofwarning light indicator, thedigital pin D8 to D13 had been set to ActivateNRF24L01 receiver and the digital pin D3to D7 and analogue pin A0 to A3 as the outputto activate LED and BUZZER. Based on Theprogrammed codes, the digital pin D6 and D7 will be activated to detect the object from detectionrange. The NRF24L01 34transmitter will transmit the signal or data from the distance read by the ultrasonic sensor. The NRF24L01 receiver will react to receivethe signal or data from the NRF24L01 transmitter. The LED and BUZZER will be activated to show the warning alert. The overall programming codesare attached. B. E. (Mechanical Engineering) – 2019 Course Page 18 SavitribaiPhule Pune University Fig.15. ADAS (advance driving assistant system ) in Mahindra XUV 700 9.References a. Jump up to Ford Motor Company (2008). "See It, Hear It, Feel It: Ford Seeks Most Effective Driver Warnings for Active Safety Technology. Increased warnings indicate potentially hazardous lane changes". Gale, Cengage Learning/Free Library. Retrieved August 11, 2013. b. Automobile Blind-Spot Monitoring System, Tri-City Insurance News, January 27, 2006 Archived December 13, 2009, at the Wayback Machine c. Jump up to:Jensen, Christopher (August 18, 2009). "Are Blind Spots a Myth?". The New York Times. Retrieved August 9, 2013. d. Jump up to :Platzer, George (February 1, 1995). The Geometry of Automotive Rearview Mirrors - Why Blind Zones Exist and Strategies to Overcome Them (Technical report).SAE Technical Paper Series. Vol. 1. Detroit, Michigan: Society of Automotive Engineers. doi:10.4271/950601. 950601. e. "How To Eliminate The Dreaded "Blind Spot"". Retrieved August 9, 2013. f. Jump up to :Quiroga, Tony; Philpot, Chris, Illustrator (March 2010). "How to Adjust Your Mirrors to Avoid Blind Spots". Car and Driver. Retrieved August 9, 2013. g. Archived at Ghostarchive and the Wayback Machine: "Ford GT90 Road Test". YouTube. B. E. (Mechanical Engineering) – 2019 Course Page 19 SavitribaiPhule Pune University h. Blind Spot Information System (BLIS®) with Cross Traffic Alert | Vehicle Feature Video | Official Ford Owner Site". ford Owner. Retrieved 2017-02-10. i. 2016 Mitsubishi Montero Sport Make Global Debut". autoindustriya.com. August 2015. j. Kiino, Ron; Walker, William, Photos (November 2009). "First Drive: 2011 Infiniti M Prototype Gutsier V-6, a Big V-8, and Even a Hybrid". Motor Trend. Retrieved August 11, 2013. B. E. (Mechanical Engineering) – 2019 Course Page 20