clara
/
kaylee
Watch 1
Star 0
Fork 0
Code Issues 5 Pull Requests 0 Releases 2 Wiki Activity
Somewhat fancy voice command recognition software
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
57 Commits
2 Branches
Tree: 9bffb8d166
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '9bffb8d166'
${ noResults }
kaylee
Clara Hobbs 9bffb8d166 Rename license file to COPYING 8 years ago
assets Added Gtk Tray UI (thanks padfoot) 10 years ago
data Added Gtk Tray UI (thanks padfoot) 10 years ago
.gitignore Ported to new pocketsphinx and pygi 8 years ago
COPYING Rename license file to COPYING 8 years ago
README.md Mention the new dependency in README 8 years ago
blather.py Rewrote language_updater.sh in Python 8 years ago
commands.tmp added gstreamer0.10-base-plugins to the requirements in the README 10 years ago
config.py Removed prints from config.py 8 years ago
gtktrayui.py Beginning work moving from YAML to JSON 8 years ago
gtkui.py Beginning work moving from YAML to JSON 8 years ago
languageupdater.py Rewrote language_updater.sh in Python 8 years ago
options.json.tmp Beginning work moving from YAML to JSON 8 years ago
recognizer.py Moved paths to Config class 8 years ago

README.md

Kaylee

Kaylee is a somewhat fancy speech recognizer that will run commands and perform other functions when a user speaks loosely preset sentences. It is based on Blather by Jezra, but adds a lot of features that go beyond the original purpose of Blather.

Requirements

  1. pocketsphinx
  2. gstreamer-1.0 (and what ever plugin has pocketsphinx support)
  3. gstreamer-1.0 base plugins (required for ALSA)
  4. python-gobject (required for GStreamer and the GTK-based UI)
  5. python-requests (required for automatic language updating)

Note: it may also be required to install pocketsphinx-hmm-en-hub4wsj

Usage

  1. Move commands.tmp to ~/.config/kaylee/commands.conf and fill the file with sentences and command to run
  2. Run blather.py. This will generate ~/.local/share/kaylee/sentences.corpus based on sentences in the ‘commands’ file, then use http://www.speech.cs.cmu.edu/tools/lmtool.html to create and save a new language model and dictionary.
    • For GTK UI, run blather.py -i g
    • To start a UI in ‘continuous’ listen mode, use the -c flag
    • To use a microphone other than the system default, use the -m flag
  3. Start talking

Note: to start Kaylee without needing to enter command line options all the time, copy options.json.tmp to ~/.config/kaylee/options.json and edit accordingly.

Examples

  • To run Kaylee with the GTK UI and start in continuous listen mode: ./blather.py -i g -c

  • To run Kaylee with no UI and using a USB microphone recognized and device 2: ./blather.py -m 2

  • To have Kaylee pass the matched sentence to the executed command: ./blather.py -p

explanation: if the commands.conf contains: good morning world: example_command.sh then 3 arguments, ‘good’, ‘morning’, and ‘world’ would get passed to example_command.sh as example_command.sh good morning world

  • To run a command when a valid sentence has been detected: ./blather.py --valid-sentence-command=/path/to/command note: this can be set in the options.yml file
  • To run a command when a invalid sentence has been detected: ./blather.py --invalid-sentence-command=/path/to/command note: this can be set in the options.yml file

Finding the Device Number of a USB microphone

There are a few ways to find the device number of a USB microphone.

  • cat /proc/asound/cards
  • arecord -l