clara
/
kaylee
Suivre 1
Favoriser 0
Bifurcation 0
Code Tickets 5 Demandes d'ajout 0 Versions 2 Wiki Activité
Somewhat fancy voice command recognition software
Vous ne pouvez pas sélectionner plus de 25 sujets Les noms de sujets doivent commencer par une lettre ou un nombre, peuvent contenir des tirets ('-') et peuvent comporter jusqu'à 35 caractères.
57 Révisions
2 Branches
Aborescence: 9bffb8d166
Branches Tags
${ item.name }
Créer la branche ${ searchTerm }
de '9bffb8d166'
${ noResults }
kaylee
Clara Hobbs 9bffb8d166 Rename license file to COPYING il y a 8 ans
assets Added Gtk Tray UI (thanks padfoot) il y a 10 ans
data Added Gtk Tray UI (thanks padfoot) il y a 10 ans
.gitignore Ported to new pocketsphinx and pygi il y a 8 ans
COPYING Rename license file to COPYING il y a 8 ans
README.md Mention the new dependency in README il y a 8 ans
blather.py Rewrote language_updater.sh in Python il y a 8 ans
commands.tmp added gstreamer0.10-base-plugins to the requirements in the README il y a 10 ans
config.py Removed prints from config.py il y a 8 ans
gtktrayui.py Beginning work moving from YAML to JSON il y a 8 ans
gtkui.py Beginning work moving from YAML to JSON il y a 8 ans
languageupdater.py Rewrote language_updater.sh in Python il y a 8 ans
options.json.tmp Beginning work moving from YAML to JSON il y a 8 ans
recognizer.py Moved paths to Config class il y a 8 ans

README.md

Kaylee

Kaylee is a somewhat fancy speech recognizer that will run commands and perform other functions when a user speaks loosely preset sentences. It is based on Blather by Jezra, but adds a lot of features that go beyond the original purpose of Blather.

Requirements

  1. pocketsphinx
  2. gstreamer-1.0 (and what ever plugin has pocketsphinx support)
  3. gstreamer-1.0 base plugins (required for ALSA)
  4. python-gobject (required for GStreamer and the GTK-based UI)
  5. python-requests (required for automatic language updating)

Note: it may also be required to install pocketsphinx-hmm-en-hub4wsj

Usage

  1. Move commands.tmp to ~/.config/kaylee/commands.conf and fill the file with sentences and command to run
  2. Run blather.py. This will generate ~/.local/share/kaylee/sentences.corpus based on sentences in the ‘commands’ file, then use http://www.speech.cs.cmu.edu/tools/lmtool.html to create and save a new language model and dictionary.
    • For GTK UI, run blather.py -i g
    • To start a UI in ‘continuous’ listen mode, use the -c flag
    • To use a microphone other than the system default, use the -m flag
  3. Start talking

Note: to start Kaylee without needing to enter command line options all the time, copy options.json.tmp to ~/.config/kaylee/options.json and edit accordingly.

Examples

  • To run Kaylee with the GTK UI and start in continuous listen mode: ./blather.py -i g -c

  • To run Kaylee with no UI and using a USB microphone recognized and device 2: ./blather.py -m 2

  • To have Kaylee pass the matched sentence to the executed command: ./blather.py -p

explanation: if the commands.conf contains: good morning world: example_command.sh then 3 arguments, ‘good’, ‘morning’, and ‘world’ would get passed to example_command.sh as example_command.sh good morning world

  • To run a command when a valid sentence has been detected: ./blather.py --valid-sentence-command=/path/to/command note: this can be set in the options.yml file
  • To run a command when a invalid sentence has been detected: ./blather.py --invalid-sentence-command=/path/to/command note: this can be set in the options.yml file

Finding the Device Number of a USB microphone

There are a few ways to find the device number of a USB microphone.

  • cat /proc/asound/cards
  • arecord -l