HMMGradients.jl

This package enables computing the gradient of the parameters of Hidden Markov Models (HMMs). This makes it possible to perform HMM training using gradient based methods like stochastic gradient descent, which is necessary for example when neural networks are involved, e.g. in modern automatic speech recognition systems.

Formally, this package extends ChainRulesCore making it possible to train HMM models using the automatic differentiation frameworks of Julia, for example using Zygote and machine learning libraries like Flux. The package also provides numerical stable algorithms to compute forward, backward and posterior probabilities of HMMs.

Installation

To install the package, simply issue the following command in the Julia REPL:

] add HMMGradients

Acknowledgements

This work was developed under the supsrvision of Prof. Dr. Hervé Bourlard and supported by the Swiss National Science Foundation under the project "Sparse and hierarchical Structures for Speech Modeling" (SHISSM) (no. 200021.175589).