Google

A sequence of hidden states, indexed from an initial point $$m$$ to a final point $$len$$, can be represented as a series of vectors: $$\mathbf{h}_m, \mathbf{h}_{m+1}, \mathbf{h}_{m+2}, \dots, \mathbf{h}_{len-1}, \mathbf{h}_{len}$$. This notation is commonly used in sequence models to denote a specific subsequence of hidden state vectors.

Example of Indexed Hidden State Sequence Notation

A sequence model generates a series of hidden state vectors, indexed starting from 1. The full sequence is represented as $\mathbf{h}_1, \mathbf{h}_2, \mathbf{h}_3, \mathbf{h}_4, \mathbf{h}_5, \mathbf{h}_6$. Using the standard notation, write out the specific subsequence of hidden state vectors that corresponds to the elements from the third position to the fifth position, inclusive.

Representing a Subsequence of Hidden States

A sequence of hidden state vectors is represented as $\mathbf{h}_7, \mathbf{h}_8, \dots, \mathbf{h}_{15}$. This sequence contains a total of ____ vectors.

A sequence model processes the sentence 'The quick brown fox jumps over' and generates a hidden state vector for each word. The vectors are indexed starting from 1, so the vector for 'The' is represented as $\mathbf{h}_1$, for 'quick' as $\mathbf{h}_2$, and so on. Which of the following correctly represents the sequence of hidden state vectors for the specific phrase 'brown fox jumps'?

Learn Before

Related