���] ��ȌW(xu��)��(x��)��Ȼ�Z(y��)��̎�팍(sh��)��(zh��n)

�� Ŀ䛣���

ǰ��
��1����ȌW(xu��)��(x��)��Փ���A(ch��)
1.1��ȌW(xu��)��(x��)�śr
1.1.1��ȌW(xu��)��(x��)�Ěvʷ
1.1.2���o(w��)�����ܡ�����ȌW(xu��)��(x��)
1.2��ȌW(xu��)��(x��)��(j��ng)�W(w��ng)�j(lu��)
1.2.1��(j��ng)�W(w��ng)�j(lu��)
1.2.2�[�،�
1.2.3�ݶ��½�
1.2.4�����(sh��)
1.2.5��(qu��n)�س�ʼ��
1.2.6���t��
1.2.7�wһ��
��2����ȌW(xu��)��(x��)��ܛ�����
2.1�h(hu��n)������
2.1.1Anaconda
2.1.2Ӣ���_(d��)GPU�(q��)��(d��ng)+CUDA+cuDNN
2.1.3PyTorch���b
2.1.4Python IDE�x��
2.2PyTorch ���T(m��n)
2.2.1Tensor��������
2.2.2Tensor���\(y��n)��
2.3PyTorch�Ԅ�(d��ng)���ݶ�
2.3.1��������
2.3.2Tensor����
2.3.3�ݶ�Ӌ(j��)��
2.4PyTorch nnģ�K
��3���Z(y��)��ģ���c�~����
3.1�Z(y��)��ģ��
3.1.1�o(w��)̎���ڵ��Z(y��)��ģ��
3.1.2��(j��ng)�W(w��ng)�j(lu��)�Z(y��)��ģ��
3.2�~����
3.2.1one-hot
3.2.2word2vec
3.2.3GloVe
3.3���a��(sh��)��(zh��n)
3.3.1�΄�(w��)1:��(y��ng)��PyTorch�Skip-Gram
3.3.2�΄�(w��)2:����GloVe�Ĵ�Ҏ(gu��)ģ�����Z(y��)�ϵ��~����Ӗ(x��n)��
��4������ģ���c�ݶ���ʧ/��ը
4.1ѭ�h(hu��n)��(j��ng)�W(w��ng)�j(lu��)
4.1.1ģ�ͽY(ji��)��(g��u)��Ӌ(j��)���^(gu��)��
4.1.2��(y��ng)��PyTorch���Ӗ(x��n)��RNNģ��
4.2�ݶ���ʧ�c��ը
4.2.1�a(ch��n)��ԭ��
4.2.2��Q����
4.3���M(j��n)����
4.3.1LSTM
4.3.2GRU
4.4���a��(sh��)��(zh��n)���LSTM/GRU���ı����(l��i)��
��5�¾��e��(j��ng)�W(w��ng)�j(lu��)��NLP�I(l��ng)��đ�(y��ng)��
5.1���e��(j��ng)�W(w��ng)�j(lu��)�ĸ���
5.1.1ݔ���
5.1.2���e��
5.1.3�ػ���
5.1.4ȫ�B�ӌ�
5.2�ն����e��(j��ng)�W(w��ng)�j(lu��)
5.2.1�ն����e�Ļ������x
5.2.2�ն����e��NLP�еđ�(y��ng)��
5.2.3�ն����e���P(gu��n)���a
5.2.4���Ӿ��e
5.3���a��(sh��)��(zh��n)��CNN���(l��i)��(sh��)��(zh��n)
5.3.1��(sh��)��(j��)̎��
5.3.2�������ɲ���
5.3.3ģ�Ͳ���
5.3.4ģ��Ӗ(x��n)���c�u(p��ng)��
��6��Seq2Seqģ���cAttention�C(j��)��
6.1Encoder-Decoder�Y(ji��)��(g��u)
6.1.1Encoder
6.1.2Decoder
6.1.3Encoder-Decoder���ڵĆ�(w��n)�}
6.2Attention�C(j��)��
6.3Seq2SeqӖ(x��n)���c�A(y��)�y(c��)
6.3.1ģ��Ӗ(x��n)��
6.3.2ģ���A(y��)�y(c��)
6.3.3BLEUģ���u(p��ng)����
6.4���a��(sh��)��(zh��n)����(y��ng)��PyTorch��C(j��)�����gģ��
��7�´�Ҏ(gu��)ģ�A(y��)Ӗ(x��n)��ģ��
7.1ELMo
7.1.1ģ�ͽY(ji��)��(g��u)
7.1.2ģ��Ч��
7.1.3ELMo�ă�(y��u)�c(di��n)
7.1.4����ELMo+CNN�M(j��n)�з��(l��i)��ʾ��
7.2Transformer
7.2.1Encoder�˼�Decoder�˿��[
7.2.2Encoder�˸���(g��)��ģ�K
7.2.3Decoder�˸���(g��)��ģ�K
7.2.4����ģ�K
7.2.5����ģ��
��8���A(y��)Ӗ(x��n)���Z(y��)��ģ��BERT
8.1BERT�Ļ�������
8.2BERT�Ĺ���ԭ��
8.2.1BERT���A(y��)Ӗ(x��n)��
8.2.2BERTģ�ͽY(ji��)��(g��u)
8.2.3BERT��΢�{(di��o)
8.3BERT�Ŀɽ����
8.4�����A(y��)Ӗ(x��n)��ģ��
8.4.1XLNet
8.4.2RoBERTa
8.4.3ALBERT
8.5���a��(sh��)��(zh��n)���A(y��)Ӗ(x��n)��ģ��
�����īI(xi��n)