! BSc!(Hons)!Music!Technology! DIG6045!Technology!Project!UG3! Assessment!1.2!–!Full!Project!Proposal! October!2015! ! ! ! Developing*Real-Time*Reverb*for*Use*in* Embedded*Systems* ! Harry!Lewis! Supervisor:!Ryan!Stables! ! ! ! ! ! ! ! ! ! Table!of!Contents! 1.0! Introduction!...............................................................................................!3! 1.1!Background!...........................................................................................................!3! 1.1.1!What!is!Reverb?!.............................................................................................!3! 1.1.2!Artificial!Reverb!..............................................................................................!4! 1.2!Scope!....................................................................................................................!5! 2.1!! Aim!...........................................................................................................!5! 2.2!! Objectives!.................................................................................................!5! 3.0! Rationale!..................................................................................................!6! 4.0! Tasks!and!Activities!..................................................................................!6! 4.1!Researching!different!reverb!design!methods!......................................................!6! 4.2!Comparing!the!Quality!of!Reverbs!........................................................................!6! 4.3!Developing!and!Testing!a!Reverb!........................................................................!7! 5.0! Resources!................................................................................................!7! 6.0! Literature!Search!Methodology!................................................................!7! 7.0! Schedule!...................................................................................................!9! 8.0! Risk!Assessment!......................................................................................!9! 9.0! Ethics!Review!.........................................................................................!10! 10.0! References!..........................................................................................!10! ! ! ! 2! ! 1.0! Introduction! ! 1.1!Background! ! 1.1.1!What!is!Reverb?! ! “Reverb'is'the'collective'name'given'to'the'sound'created'by'bounced' reflections'from'room'boundaries”!(Izhaki,!2013).!! ! When!sound!is!created!in!an!enclosed!space,!the!sound!propagates!away!from!the! source.!If!there!is!a!microphone!in!the!direct!path!of!the!sound!wave,!then!the!sound! will!be!picked!up!by!the!microphone.!The!rest!of!the!sound!wave!however!will!keep! travelling!and!will!eventually!hit!different!surfaces!and!some!of!the!sound!will!be! reflected.!Some!of!these!reflections!will!travel!to!the!microphone!and!will!be!picked!up! as!a!slightly!delayed,!and!quieter!versions!of!the!direct!sound!which!is!known!as! reverb.!Humans!do!not!perceive!these!reflections!individually,!but!instead!they!are! grouped!together!with!the!natural!sound!and!perceived!as!a!sense!of!acoustic!space! (Mike!Senior,!2000).! ! Fig.'1';'Example'of'a'Generic'Room'Response'(Valimaki'et'al.,'2012)' ! 3! ! Sound!will!arrive!at!the!listener!or!microphone!in!different!stages.!These!are!referred!to! the!direct!sound,!the!early!reflections,!and!the!late!reverberation!(Fig.!1).!The!direct! sound!goes!straight!from!the!source!to!the!microphone!as!stated!previously.!This!is! followed!by!early!reflections!caused!from!nearby!objects!and!surfaces!(for!example! bouncing!off!the!floor!between!source!and!listener).!Finally,!the!late!reverberation!is! formed!of!a!dense!set!of!reflections!which!is!indicative!of!the!size!and!the!absorbing! power!of!the!material!in!the!space!(Valimaki!et!al.,!2012).!These!different!stages!of! reverberation!collectively!are!referred!to!the!impulse!response!which!essentially! represents!the!character!of!the!space.!! ! ! 1.1.2!Artificial!Reverb! ! Recordings!without!reverb!can!sometimes!be!described!as!sounding!very!“upbclose”,! “dry”!or!“lifeless”,!so!in!situations!where!there!is!no!natural!reverb!in!the!room,!artificial! reverb!can!be!added!to!enhance!the!recording.!Artificial!reverb!methods!are!made!up! of:!acoustic!reverb!chambers,!plate!reverbs,!spring!reverbs!(all!of!which!are!analogue! methods),!and!digital!reverb!(Hurtig,!1988).!The!latter!of!which!shall!be!the!focus!of!this! project.! ! Older!hardware!digital!reverb!units!suffered!issues!with!sounding!like!a!real!space,!as! the!algorithms!used!to!create!the!reverb!effect!were!not!based!on!the!principles!of! natural!acoustics,!and!not!taking!into!account!things!like!frequency!and!early! reflections.!Another!issue!was!a!lack!of!physical!memory!in!the!unit!itself!which!limited! the!number!of!algorithms!that!could!be!stored!on!the!device!(Farquharson,!2007).! Since!then,!computer!memory!and!processing!has!increased!hugely,!and!now!most! well!specified!computers!can!run!computationally!taxing!artificial!reverb!processes!like! convolution!reverb.!Simply!put,!this!is!where!the!impulse!response!of!a!space!is! recorded!and!then!multiplied!by!every!sample!of!an!audio!signal!which!adds!the!rooms! reverb!to!the!original!signal!(White,!2006).! ! ! ! ! 4! ! 1.2!Scope! ! This!project!will!investigate!and!compare!different!methods!of!creating!digital!reverb! with!the!aim!of!being!able!to!implement!it!on!an!embedded!system!such!as!an!audio! interface.!Any!testing!and!analysis!will!be!carried!out!purely!with!the!suitability!of!the! reverb!being!applied!to!such!an!embedded!system!in!mind,!rather!than!its!suitability!in! general.!! ! 2.1!! Aim! ! This!project!aims!to!identify!and!develop!a!method!of!creating!a!realistic!sounding!and! computationally!efficient!reverb!which!would!be!suitable!for!use!in!an!embedded! system!with!limited!resources.!! ! 2.2!! Objectives! ! •! To!identify!and!compare!different!methods!of!creating!reverb!and!their! suitability!for!real!time!implementation.! •! To!explore!the!realbtime!implications!of!combining!convolution!and!algorithmic! reverb.! •! To!devise!a!series!of!tests!to!quantify!the!quality!or!realism!of!a!reverb!using! existing!methods.! •! To!outline!a!minimum!reverb!quality!and!the!maximum!resources!available!to! the!reverb!algorithm!in!an!embedded!system.! •! To!devise!and!apply!a!series!of!tests!in!Matlab!to!benchmark!the!performance! different!reverb!algorithms.! •! To!develop!the!best!reverb!method!to!maximise!quality!and!efficiency!up!to!a! point!that!meets!with!a!given!specification.! ! ! 5! ! 3.0! Rationale! ! The!ability!to!create!efficient!and!realistic!reverb!in!real!time!is!useful!for!commercial! gain!as!well!as!furthering!the!field!of!reverb!in!academic!research.!Being!able!to! include!a!high!quality!reverb!at!low!computational!cost,!without!the!need!for!extra! processing!power!or!dedicated!hardware!chips,!is!beneficial!for!commercial!companies! trying!to!cut!costs!while!maintaining!high!quality!products.!! ! 4.0! Tasks!and!Activities! ! 4.1!Researching!different!reverb!design!methods! ! •! Research!current!methods!of!creating!reverb!in!software!as!well!as!exploring! cutting!edge!research!in!the!area.! •! Explore!the!concept!of!combining!convolution!and!algorithmic!reverb!methods! as!a!way!of!reducing!computational!requirements.! •! Based!on!the!research!carried!out,!compare!each!method!of!reverb!and! establish!a!shortlist!of!methods!to!investigate!in!further!detail.! •! Design!or!find!from!existing!sources!examples!of!the!different!reverb!methods! to!write!in!Matlab!to!put!forward!for!testing.! ! 4.2!Comparing!the!Quality!of!Reverbs! ! •! Establish!a!minimum!reverb!quality!that!would!be!acceptable!for!use!in!a!piece! of!consumer!gear.! •! Through!research!of!existing!systems,!outline!the!resources!that!would!be! available!for!reverb!in!terms!of!computational!power!and!memory!in!such!a! product.!!! •! From!existing!research,!devise!a!test!or!series!of!tests!that!will!allow!different! reverb!algorithms!to!be!ranked!and!compared!objectively!in!terms!of!both! “quality”!as!well!as!efficiency.! •! Perform!the!test(s)!to!deduce!the!most!suitable!reverb!algorithm!for!use!in!an! embedded!system.! ! 6! ! 4.3!Developing!and!Testing!a!Reverb! ! •! Using!existing!research,!explore!methods!of!improving!the!most!suitable!reverb! to!make!it!more!efficient!and/or!to!improve!its!quality.! •! Continue!to!test!the!reverb!as!it!is!altered!to!track!the!progress!of!efficiency!and! quality.! ! 5.0! Resources! ! The!resources!involved!in!this!project!are!generally!restricted!to!computers!and! software,!however!as!a!way!of!applying!the!designed!reverb!to!an!embedded!system! and!testing!its!performance,!it!would!be!useful!to!obtain!a!hardware!development!kit! from!a!manufacturer!of!processors!for!audio!based!embedded!systems!such!as! XMOS.! ! With!regards!to!software,!Matlab!would!be!the!most!suitable!application!to!design!and! optimise!the!reverb!algorithms!as!it!is!a!good!platform!to!program!the!reverb!as!well!as! getting!useful!data!back!when!performing!tests!on!the!performance.!To!test!the!reverb! algorithms!in!a!simulated!embedded!system!environment,!the!software! xTIMEcomposer!can!be!used!which!is!the!development!tool!for!the!XMOS!processor! chip!technology.! ! 6.0! Literature!Search!Methodology! ! The!literature!review!will!be!performed!by!using!a!variety!of!different!sources!both! online!and!physical.!Online!papers!and!books!will!be!found!using!services!such!as! Google!Scholar!and!the!BCU!Digital!Library.!Web!searches!will!also!be!used!to!find! websites!with!useful!material,!as!well!as!finding!existing!products!or!systems!that!make! use!of!different!reverb!techniques.!From!preliminary!research,!papers!from!the!DAFX! conferences!or!books!about!digital!signal!processing!such!as!Smith’s!The'Scientist'and' Engineer's'Guide'to'Digital'Signal'Processing'(Smith,!1997)!seem!like!they!would!be! both!useful!and!reliable.!To!make!any!searches!efficient!and!to!ensure!the!most!useful! resources!are!found,!keywords!and!phrases!will!be!used!to!optimise!the!search.! ! 7! ! Possible!search!keywords/phrases:! •! Reverb! •! Realbtime!effects! •! Embedded!systems! •! DSP!effects! •! Convolution! •! Impulse!response! •! Algorithm! ! Once!a!resource!has!been!found!using!search!engines!and!these!keywords,!they!will! need!to!be!assessed!to!identify!their!relevance!and!quality.!The!relevance!of!a!piece!of! work!will!be!assessed!by!first!reading!the!titles!and!creating!a!shortlist.!Then!from!the! list,!the!abstracts!of!papers,!and!the!blurbs!and!introductions!of!books!will!be!read.! This!will!give!an!idea!on!the!subject!matter!and!in!what!direction!the!piece!of!work!will! take,!however!even!if!the!subject!matter!seems!like!it!will!be!of!some!use,!the!reliability! and!quality!of!work!must!also!be!taken!into!account.!This!means!investigating:! •! The!number!of!citations,!which!gives!a!very!quick!way!of!telling!whether!a! piece!of!work!is!seen!as!good!by!the!academic!community.!If!it!has!been!cited! in!many!other!people’s!work,!then!it!shows!that!those!people!considered!it!to! be!a!trusted!piece!of!work.!A!new!piece!of!work!might!only!have!a!few!citations! so!this!cannot!be!the!only!judge!of!the!quality.! •! Whether!the!author!has!other!material!published,!and!the!overall!response!to! it.!Establish!whether!the!author!has!any!professional!links!with!the!subject!area! and!consider!any!potential!bias!this!may!introduce.!The!work!could!simply!be! written!for!research!purposes,!or!instead!for!commercial!gain.!! •! If!a!piece!of!work!has!few!referenced!sources!of!its!own!and!little!backing!up!of! evidence,!it!is!possible!that!it!cannot!be!trusted!to!provide!accurate!information.! •! The!target!audience!of!the!piece!of!work.!For!example,!if!the!work!is!presented! for!middle!education!or!for!general!members!of!the!public,!it!is!possible!that!the! work!has!been!oversimplified.!! ! Once!all!of!this!has!been!taken!into!account,!it!will!be!possible!to!decided!how!useful!(if! at!all)!a!piece!of!work!will!be.!Both!the!relevance!and!reliability!of!work!can!be!graded! using!a!scale!of!0!b!10!which!will!give!a!rough!order!to!approach!the!work.!A!document! outlining!useful!sections!and!quotes!from!the!sources!will!be!created!using!software! such!as!Evernote,!OmniFocus!or!Zotero,!where!appropriate!tags!can!be!applied!to! allow!easier!navigation!when!revisiting!findings.! 8! ! 7.0! Schedule! ! A!common!method!of!planning!a!project!is!using!a!Gantt!chart.!It!displays!a!list!of!tasks! or!events!over!time.!The!tasks!are!stretched!across!the!time!axis!to!give!an!indication! of!when!they!should!be!beginning!and!ending.!More!detailed!Gantt!charts!can!give! further!information!such!as!task!dependencies!and!links.!These!illustrate!the!work!flow! of!the!various!tasks,!which!is!useful!to!visualise!how!certain!tasks!depend!on!other! tasks!being!completed!before!any!work!can!be!started!on!them!for!example.! ! For!this!proposal,!a!fairly!simple!Gantt!chart!has!been!provided,!however!as!the!project! matures,!a!more!detailed!Gantt!chart!can!be!created.!The!project!Gantt!chart!will!be! kept!up!to!date!as!the!project!progresses,!identifying!any!previously!unforeseen! changes!to!tasks!or!timings.! ! ! 8.0! Risk!Assessment! ! This!project!requires!the!use!of!a!computer!for!almost!all!aspects!other!than!reading!of! physical!material!so!one!of!the!main!risks!is!being!sat!at!a!computer!screen!for!too! long.!Possible!problems!arising!from!this!include!posture!issues,!headaches!and!sore! eyes.!This!can!be!managed!by!taking!regular!breaks!from!the!computer!while!working.! Based!on!various!sources,!the!general!consensus!is!that!for!every!hour!of!work!a! person!should!take!a!five!or!tenbminute!break!in!which!you!are!away!from!the! computer!and!not!sitting!down.! ! 9! ! Another!potential!hazard!is!listening!levels!when!testing!the!different!reverbs.!If!the! listening!level!is!above!85dB,!permanent!damage!can!be!caused!to!the!auditory! system!after!eight!hours,!with!the!exposure!time!decreasing!as!the!level!increases! (World!Health!Organisation,!2015)!This!will!be!prevented!by!ensuring!that!listening! levels!are!kept!below!85dB!or!if!they!go!above,!that!a!safe!exposure!time!is! maintained.! ! 9.0! Ethics!Review! ! Having!taken!the!online!ethics!test,!no!major!issues!arise!from!this!project!ethically.! However,!from!the!risk!assessment,!one!of!the!potential!hazards!is!exposure!to!loud! sounds!when!testing!different!reverbs.!Managing!this!hazard!will!be!of!paramount! importance!if!playing!the!reverbs!to!third!party!listeners.!This!situation!could!arise!if! performing!listening!tests!to!establish!the!“quality”!of!a!reverb.! ! 10.0!References! ! Hurtig,!B.,!(1988)!Multi;Track'Recording'for'Musicians.!Alfred!Music.! ! Mike!Senior,!(2000)!Reverb';'Frequently'Asked'Questions.!Sound!on!Sound.! ! Smith,!S.W.,!(1997)!The'Scientist'&'Engineer’s'Guide'to'Digital'Signal'Processing,!1.! ed.!ed.!California!Technical!Publ,!San!Diego,!Calif.! ! Valimaki,!V.!et!al.!(2012)!Fifty'Years'of'Artificial'Reverberation.!IEEE!Trans.!Audio! Speech!Lang.!Process.!20,!1421–1448.!doi:10.1109/TASL.2012.2189567! ! White,!P.,!(2006)!Choosing'The'Right'Reverb.!Sound!on!Sound.! ! World!Health!Organisation,!(2015)!Make'Safe'Listening.' ! ! 10! !