End-to-End User-Defined Keyword Spotting with Shifted Delta Coefficients

Download Presenatation
end to end user defined keyword spotting using n.w
1 / 17
Embed
Share

"Explore the innovative approach of End-to-End User-Defined Keyword Spotting using Shifted Delta Coefficients for large-vocabulary continuous speech recognition and ASR-free systems. Learn about dynamic sequence partitioning and attention-based cross-modal matching. Dive into the method's speech features, including Mel Spectrogram and Mel-Frequency Cepstral Coefficients. Discover the dataset details of LibriPhrase and Google Speech Commands for training and testing. Unveil the advanced techniques and models like Bi-GRU and Pretrained Tacotron 2 for audio and text encoding. Enhance your understanding of Pattern Extractor and Discriminator components for efficient keyword spotting."

  • End-to-End
  • Keyword Spotting
  • Speech Recognition
  • ASR-Free
  • Dynamic Sequences

Uploaded on | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.

E N D

Presentation Transcript


  1. End-to-End User-Defined Keyword Spotting using Shifted Delta Coefficients Kesavaraj V, Anuprabha M, Anil Kumar Vuppala

  2. Introduction specific wake-up words Okay Google "Hey Siri" user-defined keyword spotting (UDKWS) large-vocabulary continuous speech recognition (LVCSR) keyword/filler hidden markov model (HMM) end-to-end systems query-by-example (QbyE) ASR-free end-to-end system attention-based cross-modal matching approach novel zero-shot UDKWS dynamic sequence partitioning

  3. Method Speech features Audio Encoder Text Encoder Pattern Extractor Pattern Discriminator

  4. Method - Speech Feature (Mel Spectrogram)

  5. Method - Speech Feature (Mel-Frequency Cepstral Coefficients)

  6. Method - Speech Feature (PLP)

  7. Method - Speech Feature (RASTA-PLP)

  8. Method - Speech Feature (SDC)

  9. Method Audio Encoder Bi GRU

  10. Method Text Encoder Pretrained Tacotron 2 model

  11. Method Pattern Extractor & Pattern Discriminator Audio Embedding Key Value Text Embedding Query

  12. Dataset LibriPhrase Train train-clean-100 train-clean-360 Test train-others-500 Episodes 4391 2605 467 56 Each episode has three positive and three negative pairs Negative samples are categorized into LibriPhrase Easy (LPE) and LibriPhrase Hard (LPH) based on Levenshtein distance Google Speech Commands V1 Qualcomm Keyword Speech

  13. Results

  14. Results - SDC configuration

  15. Results - Analysis on the length of keywords

  16. Results - Comparison of various UDKWS techniques

  17. END

More Related Content