GSoc 2012-Voice Control For Banshee

The idea is to add voice control for Banshee media player to improve the accessibility. Many portable media player devices can be controlled using the human voice and it has resulted in the users having a rich accessibility interface. The plan is to let the user do basic controls through his voice which will be helpful for the people who can't use the normal mouse controls. Abstract idea of the project I was selected. Banshee via GNOME

Comments

Post a Comment

Popular posts from this blog

GSoc 2012 Final Report

I had a great summer engage in a project for Banshee media player developing a voice control extension for it. My main goal was to enhance the usability and accessibility of Banshee. For that I used the pocketsphinx and sphinxbase packages of CMUsphinx speech recognition tool kit. It was challenging to integrate it to Banshee media player as it has used Mono technologies and CMUsphinx is developed using C. I used the gstreamer pipeline to get the input continuously from the microphone. To enable the extension first PocketSphinx has to be added to your system. These are the steps you should follow in Ubuntu. First download pocketsphinx and sphinxbase packages and wnzip them. Then build them and installed them % ./configure % make % make install do this for both folders.  Then ran the  export LD_LIBRARY_PATH=/usr/local/lib export PKG_CONFIG_PATH=/usr/local/ lib/pkgconfig command in the terminal. then  pocketsphinx_continuous command worked. please refer to this
Read more

Progress of the Voice Control For Banshee

Week # 03 & Week 04   I started coding to record a voice clip through the microphone. Got added to GNOME Planet. Created project details in wiki.   There are several ways to add voice control for Banshee. What will be the best ? It is to be found out. I should try several options and choose what will be the best. Speech recognition can be used by using a frame work .  Simon project  was implemented in C/C++ and tried to connect to Banshee. Simon uses a software called Hidden Markov Model Toolkit (HTK) to generate the speechmodel. This software is free of charge, but its licence prohibits its distribution with Simon. So it will be a main dependency for the project. Gnome had a project which was implemented for GSoc 2007. The project was GnomeVoiceControl was implemented in C in conjunction with CMU Sphinx, which is an open source tool, created to convert speech to text. Banshee was developed using Mono IDE and .NET platforms which I have to write a C# code to c
Read more

Update Voice Control for Banshee

I tested few speech recognition frameworks that are available free to use Simon , GNOME Voice Control and two of them had some difficulties to be used in with Banshee C# code. GNOME Voice Control was developed for GSoc 2007 project and it seems not much work recently done on it. CMUSphinx group of speech recognition systems developed at Carnegie Mellon University. CMUSphinx toolkit is a leading speech recognition toolkit with various tools used to build speech applications. CMU Sphinx toolkit has a number of packages for different tasks and applications. It’s sometimes confusing what to choose. Pocketsphinx — lightweight recognizer library written in C. Sphinxbase — support library required by Pocketsphinx I'm going to use these two library files to be integrated to Banshee code base. In Ubuntu 11.10 environment : To build and install SphinxBase. I downloaded directly from the repository, % ./autogen.sh then compiled and installed: % ./configure % make
Read more