自然语言处理---Language Model

• Noisy Channel Model
• • 举例说明
• Language Model
• • Chain Rule
  • Markov Assumption
  • • Markov Assumption Example
  • Unigram
  • Bigram
  • N-gram
• Evaluation of Language Model
• • Perplexity
• Smoothing
• • Add-one smoothing
  • Add-K smoothing
  • Interpolation
  • Good-Turning smoothing

Noisy Channel Model

举例说明

Language Model

语言模型：用来判断一句话从语法上是否通顺

Chain Rule

Markov Assumption

Markov Assumption Example

Unigram

Bigram

N-gram

Evaluation of Language Model

Perplexity

Smoothing

Add-one smoothing

Add-K smoothing

Interpolation

Good-Turning smoothing