Weekly Report March 30, 2014 CPRE/SE 491 Group Number and Name: DEC 14-11 VirtuTrace Speech Recognition Client / Advisor: Dr. Nir Keren Custom Project Name: VIRS (VIRS Is Recognizing Speech) Team Members: Name James Boddie Colleen Riker Geoffrey Miller Karl Akert Michael Potter Team Role Key Idea Holder Leader Webmaster Webmaster Communication Adviser Meeting (1 hr) Present Present Present Present Present Team Meeting (2 hrs) Present Absent Present Absent Present Adviser Meeting Summary During our adviser meeting on Wednesday 26, we went over our voice recognition demonstration with Andrew our project contact. He said he was very impressed with our work so far. Our demonstrations consisted of voice recognition, speech synthesis, sounds recording, and a sample house state machine to test the project with. Individual Accomplishments: James Boddie – Worked with the team members to get sphinx installed on all of their systems. Researched Pocketsphinx enough to incorporate it into our VIRS project. It was recognizing custom word dictionaries created by Michael, and finished getting it working into the VIRS demonstration. In addition, he also researched and added RTAudio to the demonstration project for sound recording. He also finished work that involved creating the state machine sample house for the demonstration to run on. Geoffrey Miller – Geoff started this time with getting Pocketsphinx installed onto his virtual machine, and he had only a little issue with his microphone that was quickly resolved. He worked on voice synthesis for our demonstration, and he decided that Festival (Festvox) library was the way to go. Several hours were spent towards research on the libraries, installation, and incorporation of this into our project. He also was the final test and debugger for getting the demonstration to run. Michael Potter – Michael got Pocketsphinx installed on his Linux Virtual Machine, and then went into researching and implementing the use of custom dictionaries for Pocketsphinx. He got that working with our sample demonstration without issue. Then he went into researching libraries and implementation of voice recording systems for Linux. He looked into Port Audio and Base Audio, but they ended up not being ideal for our project. We settled on RTAudio due to its ease of integration. Colleen Riker – Colleen first started with getting Pocketsphinx setup on her computer, and she got that installed and running without issue. Afterward she began researching on Dictionary/Map libraries for C++ for us to store commands as keys and function pointers as Weekly Report March 30, 2014 CPRE/SE 491 values for key-value pairs in our project. She finished incorporating that into a sample project for us to work off of. Afterward, she worked with Michael in researching sound recording for use in the project. Even though the libraries researched were not used it was still important to have knowledge of our options and learn what other libraries had to offer. She also worked on creating the original structure of the demonstration class, which was later optimized by Geoff. Karl Akert – Karl started by getting Pocketsphinx installed on his dual-booted Linux machine, and finished that without issue. He worked with Geoff in getting Festvox installed and setup. He was the main go-to guy for GIT and Linux help. He wrote the main skeleton code for our project’s API (VIRS API). Afterward he worked on getting Festvox Festival installed on his machine. Next Steps James Boddie – On Wednesday April 2nd James will be with the team receiving the C6 training to get access to the C6 room whenever needed. Throughout the week he will work with Karl to implement interpretation of sentenced commands. This will involve some probability and key word finding. This needs to be completed by April 14th so the VIRS API can start being implemented with the actual C6 project. Geoffrey Miller – On Wednesday April 2nd Geoff will be with the team receiving the C6 training to get access to the C6 room whenever needed. Throughout the next two weeks Geoff will be developing the VIRS logging system for tracking received and given commands by the system. This needs to be done by April 14th so the VIRS API can start being implemented with the actual C6 project. Michael Potter – On Wednesday April 2nd Michael will be with the team receiving the C6 training to get access to the C6 room whenever needed. For the next two weeks Michael will be working on push button timed recording of voice to pick up what users say, so that is can be interpreted. This needs to be accomplished by April 14th so C6 implementation can begin. Colleen Riker – On Wednesday April 2nd Colleen will be with the team receiving the C6 training to get access to the C6 room whenever needed. For the next two weeks she will be working with creating the pre-recorded commands and playback of them to respond to the users of the C6 and VIRS system. This has to be done by April 14th so that implementation into the C6 can begin. Karl Akert – On Wednesday April 2nd Karl will be with the team receiving the C6 training to get access to the C6 room whenever needed. Throughout the week he will work with James to implement interpretation of sentenced commands. This will involve some probability and key word finding. This needs to be completed by April 14th so the VIRS API can start being implemented with the actual C6 project. Weekly Report March 30, 2014 CPRE/SE 491 Current Problems and Issues There were many issues with finding libraries and getting the same systems to work on everybody’s Linux systems in the same way. We currently do not have knowledge of the exact C6/VirtuTrace application we will be working with and replacing the decision matrix for, so at our next meeting on Wednesday April 2nd we will be getting this information to move forward in our development. NAME Colleen Riker James Boddie Geoff Miller Michael Potter Karl Akert Hours this week 14 18 23 16 14 HOURS Cumulative 38 51 53 39 44