信息技术-人工智能系列之一从RNN到ChatGPT：大模型的发展与应用-东北证券[]-20231114【58页】正式版.docx

Ez6-÷y2023-ll-14“ 300 淋-20231103yri Transformer yx÷ -y k GPT-20231030:2023 Ot> ugt>yRce子;-20231027:p÷i6BND ;-20231026tzvcyGvgEn ÷ySO55O521100001 021-61002390 wangqi_5636Ez/NyIRNNrChatGPTykNP-yyyWONFBTWybnaoyjyyDUWDnyyyyewiv×IY2ik_Iao6o_ysoINnOyvwyoNoW÷luotw×UUyt>g2oV)n0VyyuV÷ikoao×l×yUPyi0iW÷IoP-o2IiuWkrgyDVCVoCNuIyt1:NOtkIryIoe6)u_；kaoUyO_iyf)newivoyotuewiU3veUry2Iyiyyy|?oyt)ik：zyPwt>yYg)yY0;UBERTyIeioOvrw×tiyynyoo×lUIgogyygbU-UiyoChatGPT2oIuIytkyyrlyl1×1VIeNUiOw×PoyV÷ikU-yoOUniuUYy-IyIkakaoeyiUiGPT-4Vkak-ie-kak662gyoV÷IikW÷toPyU2a<<IikBO_RW÷l5<iu9uvW“人aV÷lbyol÷Tur-WyiONaoO_÷iugm÷6W2ikNPkt>rNnY6|，U2IyDnUewivaoOioykOIy-veUrgewiyyW÷I-g-2IaoOryyYr×t>yk6i0iNyoyU2oW÷loyikPi6UtuovOV÷m÷yy-PyoU÷Iu6Uo2ogywaoNoU_WysiyiikNgYyi3×0Umoc2t>yykymPyyPoyi×6uoy0ieoge62东北证券股份有限公司.NORTHEASTSECURITIESCO.,LTN91. ikvUao641.1. _44IRNNrChaiGPT41.2. eP_ik41.2.1. yyy)-RNN61.2.2. W>>b-LSTMNyyyWS-GRU81.2.3. y-ey-÷H1.3. ioOv121.3.1. ioOv121.3.2. Transformer÷14'y!k201.4.L'yluk201.3.3. N0os'yiuk201.3.4. 'ykyGPT211.3.5. ykryBERT221.4. iky-yio241.4.1. Oy'yik2415.2.n-Prompt251.5.3. ik8o-yio44GPT-3.5UChaiGPT281.5.4. k-yioyUgb331.6. _yUO352. ikPN372.5. ikf>372.6. kY432.7. kak443. ikW÷IPN-o493.5. ioo×NyyU493.1.1. kuu×493.1.2. ÷Iuu×503.1.3. eIIouv5132.oV÷NVyU523.2.1.oNuo523.22ouoV÷v523.3. iyrNiyU533.3.1. iyr533.3.2. iyiU543.3.3. iy|)Ndebug543.4. og6yU554. f>yo56I)IWDkB5D2yUBeD*ea5D3，yyyDoD6D4vjjM0yyyDoj“*x88*8“*7Dyyyb°yc9东北证寿R9份有限公司I-5Northcqstsccunesco.ltoN旷|一t>6yyyyWSy10p7yy-ey÷11|)8yo0vot>13p9yeioUvop14DIOytransforiner÷15plly)ioUv<17。12yeyeyot>18b13yELMot)ycUy_io|)21b14yGPT"yky0j22pISyELMolGPTlBERT0uy>23D16yGPT-2TNLPyooeoj25D17VoyAIn-ContentLearningNFine-Tuninguy)26b18yOtkOIuSukBedoVb27卜19yGPT-3rChatGPTaoi)2920yyibU-yi)31b21yO-yy-QGPT-3kVt)34)22yikyo)3823yChatGPTyy»3924yChatGPTyy件39b25yChatGPT6×yUp40b26yChatGPTVy件41p27yChatGPTUyU件43f)28ykaenyJiyD45t>29ykayOfo)45b30ykauob46)31yka<46()32yka_n<47t>33yChatGPTuPDFkijJ)49D34yChatGPTuPDFkIjbyyy50t>35yChatGPT6×Iioy-j)51D36yChatGPTV÷eptjp51卜37yChatGPTiyrijb53D38yChatGPTiyiUijb54D39yChatGPTwvGPTsBVjD55东北证方RS份有限公司I-3xNORTHeQSTMCURITiesCO.LTONyI1. ikvao61.1. _441RNNrChatGPTewiVyNaturalLanguageProcessingyNLPyo<<yuljy-yiSoNniOuy|-U_««yy_velvlrUkyDiyyt6NbiewuyU2IewivaoyyioyUlyyylV÷loyP2wyf>nao6yjyyDijWDnyyyyewiv×iY2ewivyyir20z50-iy-÷<<yuy-U1«ygouewiver2isilUyI÷IyyyUiyfUIygi÷V÷220p80iyw<<yyU6UUiyuoyy<<yyewivsoywO2N÷y>>yly<<yUlVIligoiyy)yu62u21f>ywoShyyf)nao6weulewivo2I2010-yTomasM汰Ok)VOw_ulytyyyjyRNNyik-0yewivuIU6÷22015DzmitryBahdanauf>»:Neuralmachinetranslationbyjointlylearningtoalignandtranslate;ouioOvyikyinriuiyksyylwveUri÷2×Transformeryy×IioOvy_Iyewivao2i<o2018-uBERT-ie-yikyYkewiv6erINn3y2-yika÷wnIkiyNi'yyrNnikyw0y6NiyyuolyoyWlkgyy÷yo-×W2OpenAI6_GPT-3ky6uer1750yywyyOowjyykewivyUuION115y2g-GPT-4.0zoyulkiriy!NyuWyoikNoyivgeOkayjli÷loyiokak2ouk÷uiyikT5yyiUT5ywoiegaov21.2. eP_ikikNny×yooWo2UlououoyuuoyW÷WioywoouoOsiyu2ooioku6WyUyu<<syuo-Uy5yve2oyvSWuoykSco)IOEoIo92WyoNnuoRW*.4,lv*-.l*sygol8W0Nn÷QWt½-yM-2Kr*)UyP-kgo11oyNnyy,W!)u_2_oyyuuou-w×ruoPl>yy<<y6uw÷0iPy26oNnyyg11<<yuwv2CiiBnyyNonyu2Nyuj?J)U+y6URWyO×÷jISW×6iopsEo8wg%”,峰$&，)2Byuo->M÷yduuN w东北证券股份有限公司Northcqstmcuriticsco.ltdoOyyi-yNnuWye6y2iu_oyUi-t÷y60-uuoyyo×r÷y0-×6ioyomyO2yk<<ueP-kyautoregressivemodelsy2HH)t-1时樽步tfl神及用络入序列歙据序列全速M同塔FNNUOgbyAWFZUG gWoyYytyu(XwoI(O1WW>IOsg0ftW0Nn÷i>降S2yUyi降OS9(Ws)«$外_/$K%/s&DbdU/$2Uer>.kCylatentautoregressivemodelsy2D2yel>-kot)象据序列时同步t-1时同步t时同步t÷lUOgDyAWFZN w东北证券股份有限公司Northcqstmcuriticsco.ltdet>-ky-e6WyoyyyyyyrecurrentneuralnetworkyRNNyi0wO6y-yyyWSygatedrecurrentUnitsyGRUylyy>>f)ylongshort-termmemoryyLSTMyyoyeP-k2ik÷NnYyooWicyyUoWickNnyywuUuyoyt)yOW2IeOyOWrWysequencetosequenceyseq2seqynyoyj6uiy-爸yycncoder-decodery÷