> For the complete documentation index, see [llms.txt](https://luweikxy.gitbook.io/machine-learning-notes/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://luweikxy.gitbook.io/machine-learning-notes/natural-language-processing.md).

# 自然语言处理

* [返回顶层目录](https://github.com/luweikxy/machine-learning-notes/tree/35283bef55e55cf2bba80b21e40ce68d2f5c12f0/SUMMARY.md)
* [自然语言处理概论](/machine-learning-notes/natural-language-processing-introduction.md)
* [自然语言](/machine-learning-notes/natural-language.md)
* [语言模型和中文分词](/machine-learning-notes/language-model-and-chinese-word-segmentation.md)
* [Seq2Seq模型和Attention机制](/machine-learning-notes/seq2seq-and-attention-mechanism.md)
* [Self-Attention和Transformer](/machine-learning-notes/self-attention-and-transformer.md)

\===

[从Word Embedding到Bert模型—自然语言处理中的预训练技术发展史](https://zhuanlan.zhihu.com/p/49271699)

[从One-hot, Word embedding到Transformer，一步步教你理解Bert](https://mp.weixin.qq.com/s/rxkHtRPMrEZPHzyq2UD4Fg)

[从Word2Vec到Bert，聊聊词向量的前世今生（一）](https://mp.weixin.qq.com/s/LaikrZUGlzn864ttdeyBLQ)