The objective of skip-gram model is to find representations of words that are useful for predicting the 'contexts' — surrounding words.
Given a sequence of training words \(w_1, w_2, \ldots, w_T\),
$$ \frac{1}{T} \sum_{t=1}^{T} \sum_{-c \ge j \ge c, j \neq 0} \log p(w_{t+j} | w_t) $$
Incoming Links #
Related Articles (Article 0) #
Suggested Pages #
- 0.228 Hierarchical softmax
- 0.080 Softmax function
- 0.059 Word embedding
- 0.055 Graph embedding
- 0.047 Sentence embedding
- 0.044 Softmax
- 0.038 tf-idf
- 0.025 Tomas Mikolov
- 0.025 wiki2vec
- 0.025 Paper/Perozzi2014
- More suggestions...