makserge / esp-va-sdk Goto Github PK

The ESP-Voice-Assistant SDK provides an implementation of Amazon's Alexa Voice Service, Google Voice Assistant and Google's conversational interface (aka Dialogflow) for ESP32 microcontroller. This facilitates the developers to evaluate ESP32 based voice assistant/s integrated devices like speakers and IoT devices. Please refer to Changelog to track release changes and known-issues.

The SDK contains pre-built libraries for Alexa, GVA and Dialogflow along with sources of some of the utility components such as audio pipeline and connection manager. Below are the list of features supported for each voice assistant:

• Alexa:

  • Basic Alexa conversation
  • Alexa dialogues and multi-turn
  • Audio Streaming and Playback: Saavn, Amazon music, TuneIn (Only limited stations are supported as of now)
  • Audio Book Support: Kindle, Audible
  • Volume control via Alexa command
  • Seek support for Audible
  • Alerts/Timers, Reminders, Notifications

• Google Voice Assistant:

  • Basic conversation
  • Multi-turn conversations
  • Getting weather reports
  • Multiple language support

• Google Dialogflow:

  • Basic conversation
  • Multi-turn conversations
  • Configure and control connected devices via voice, e.g "Turn the light on"
  • Multiple language support

The SDK supports the following hardware platforms:

• ESP32-LyraT
• ESP32-LyraTD-MSC

The following list of acoustic front-ends is also supported. Please contact Espressif to enable acccess to these solutions.

• DSPG DBMD5
• Intel s1000
• Synaptics CX20921

• Follow the README-Getting-Started.md to clone the required repositories and to compile and flash the firmware.
  • When flashing the SDK for the first time, it is recommended to do make erase_flash to wipe out entire flash and start out fresh.
• Go through README-<voice_assistant>.md to know how to provision the device and to get authentication tokens from respective authorization server and flash them onto the device.
• Check example application's README for board or example specific changes that might be required.
• If you are updating from previous release, please check README-FIRST.md to know about any specific actions that needs to be taken while upgrading.