GSoc 2012-Voice Control For Banshee

The idea is to add voice control for Banshee media player to improve the accessibility. Many portable media player devices can be controlled using the human voice and it has resulted in the users having a rich accessibility interface. The plan is to let the user do basic controls through his voice which will be helpful for the people who can't use the normal mouse controls. Abstract idea of the project I was selected. Banshee via GNOME

Comments

Post a Comment

Popular posts from this blog

Update Voice Control for Banshee

I tested few speech recognition frameworks that are available free to use Simon , GNOME Voice Control and two of them had some difficulties to be used in with Banshee C# code. GNOME Voice Control was developed for GSoc 2007 project and it seems not much work recently done on it. CMUSphinx group of speech recognition systems developed at Carnegie Mellon University. CMUSphinx toolkit is a leading speech recognition toolkit with various tools used to build speech applications. CMU Sphinx toolkit has a number of packages for different tasks and applications. It’s sometimes confusing what to choose. Pocketsphinx — lightweight recognizer library written in C. Sphinxbase — support library required by Pocketsphinx I'm going to use these two library files to be integrated to Banshee code base. In Ubuntu 11.10 environment : To build and install SphinxBase. I downloaded directly from the repository, % ./autogen.sh then compiled and installed: % ./configure % make...
Read more

GUADEC 2012 and my Lightening Talk

The GUADEC 2012 speeches and main events were ended and now it is Hackfests and Bofs time. I'm hacking on my GSoc project to  enhance the speech recognition accuracy. I met Arun Raghavan one of the main contributors of the PulseAudio and he added some important suggestions for my work. I'm going to follow his suggestions regarding removing the noises out of audio and extracting only the voice attributes. It was a brilliant chance to be at GUADEC 2012 and meet so many Hackers working on different backgrounds. I had the chance to listen to their experiences, the problems they faced and how they were able to overcome them. This will help me to be more productive professional :) I did my lightening talk on "Enhancing the accessibility through voice control for Banshee "  Download The Presentation Slides here. Your suggestions and comments about my work and my speech is highly appreciated as it will help to improve my future work. :)
Read more

Integration of the Pocketsphinx to Banshee

Image
I was able write some C code and make the pipeline . But in the beginning (Gst.Pipeline) Gst.parse_launch("gconfaudiosrc ! audioconvert ! audioresample ! vader name=vad auto-threshold=true ! pocketsphinx name=asr ! fakesink"); code didn't work in my Ubuntu 11.10 system as  there was a problem with "gconfaudiosrc". Then I installed some packages and tried. It worked well. Now I could make the GStreamer pipeline through C code. Then I was able to implement make files getting the help of my Mentor Alex K. He gave me permission to commit to the community extensions of Banshee media player. So I created a branch called voicecontrol and committed the make files and the basic file structure. He guided me to learn the basics of the Git commands. I implemented C# code and invoked the C functions and able to get a out put results. When I run the code microphone was listening and continuously detected the sounds and converted them to  text....
Read more