This is Part Two of the Exploring LSTMs Tutorial. If you haven't read Part One on LSTM basics, head on over now. Don't worry, this post will still be here when you get back. Investigating LSTM Internals Let's dig a little deeper. We looked in the last section at examples of hidden states, but I wanted to play with LSTM cell states and their other memory mechanisms too. Do … [Read more...] about Exploring LSTMs: Investigating Internals (Part Two)
Exploring LSTMs: Understanding Basics (Part One)
The first time I learned about LSTMs, my eyes glazed over. [latexpage] Not in a good, jelly donut kind of way. It turns out LSTMs are a fairly simple extension to neural networks, and they're behind a lot of the amazing achievements deep learning has made in the past few years. So I'll try to present them as intuitively as possible – in such a way that you could have … [Read more...] about Exploring LSTMs: Understanding Basics (Part One)