Ihuriro rimwe-rusange Rusange Paradox: Impamvu Generator AI irwana namakuru mashya

Generative AI ntakintu cyabaye kigufi cyumuyaga. Abanyamideli nka GPT-4 bafashe isi yose hamwe nubushobozi bwabo butangaje bwo gutanga inyandiko yigana ibiganiro byabantu, kwandika inyandiko, code, ndetse bikazana ibisubizo bishya kubikorwa bimwe bigoye. Turahora twiyegereza ejo hazaza hafashwa na AI, aho abafasha bacu ba digitale bazumva bitagoranye kandi bagasubiza ibyo dukeneye. Birahagije kugira umuntu wese wizera, sibyo?

Nibyiza, hafi… ariko sibyo.

Reba, munsi yumusaruro wa GPT wuzuye kandi muburyo bwiza bwikibonezamvugo ni imbogamizi yibanze, imwe itera benshi muri twe abahanga mu bya tekinoloji: AI itanga imbaraga zo guhangana namakuru mashya rwose, cyane cyane muburyo bumwe bwo kwiga. Iki kibazo gisa nkicyoroshye (nyamara kibabaje) kigaragaza icyuho nyamukuru muri sisitemu ya AI. Nubwo ushoboye guhuza ibice bitangaje biva muri miliyari za datapoint, mugihe uhabwa udushya nyabwo - ikintu kitigeze kibona mbere cyangwa cyatojwe - Moderi yuburyo bwa GPT yakubise urukuta.

Ibi bishushanya ishusho yibyo nise "One-Shot Generalisation Paradox" : niyo yaba ifite imbaraga zingana gute, nubwo sisitemu ya 'ubwenge' ya AI nka GPT isa nkaho, iratandukana mugihe isabwa guhuriza hamwe byihuse uhereye kumutwe umwe cyangwa muto. ingero zitagaragara.

Reka dupakurure iyi paradox gato hanyuma twibire kumpamvu iri inyuma yacyo. Ariko ntugahangayike, ntituzakomeza kubika filozofiya gusa - tuzamanuka mucyondo cya tekiniki hanyuma dusuzume icyabuza rwose AI-gen-gen-yacu guhuza nubworoherane bwubumaji abantu bafite mugihe bahanganye nabatamenyereye.

Ubumaji na Mechanism ya Moderi Yibyara… Kugeza Bavunitse

Ubwiza bwibanze bwikitegererezo nka GPT-4 bushingiye ku buhanga buhanitse bwa Transformer , buzwiho guha imbaraga ibintu byose kuva imiterere yindimi kugeza kubikorwa byerekezo. Noneho, sinshaka kugutera ubwoba hamwe na jargon hakiri kare muri iki gice (turimo gutangira), ariko ibice bimwe byikoranabuhanga bigomba gupakururwa kugirango byumvikane aho n'impamvu ibice bitangiye kwerekana.

Kubatangiye, GPT ni iyumuryango wurugero rushingiye kumurongo , watojwe guhanura ijambo rikurikira cyangwa ikimenyetso mubice byose byanditse. Nigute bashobora kuba beza kuri ibi? Ahanini, biterwa nuburyo bwo kwiyitaho bwubatswe muri Transformer , butuma izo moderi zishungura mumyandiko myinshi kandi cyane cyane "kwibanda" kubice byingenzi byinteruro kandi ikanareba amagambo yose uko yakabaye. Ubu buryo bwo kwita ku isi byihuse bwabaye inkingi yo gufata ibisobanuro-byumvikanisha ibice byinshi by umwandiko.

Ariko dore ipfundo rya paradox: AI Generative ishingiye cyane kuri aya makuru yamahugurwa. Ntibisanzwe kumenya imiterere nubusabane bwibarurishamibare hagati yikimenyetso mumibare yabonetse mbere, ariko nanone biterwa namakuru. Igihe icyitegererezo cyasohokaga, GPT-4 ntabwo yari yarize gutekereza gutekereza cyangwa guteza imbere imyumvire yisi. Ahubwo, ni ugukoresha amashyirahamwe yatoraguye miriyari yingero zinyandiko ziboneka kumurongo (mubitabo, Wikipedia, Reddit insanganyamatsiko, impapuro zamasomo… urabyita).

Mugihe rero, mugihe GPT ishobora kumva nkibintu byose bibona, bitanga ibisobanuro bihuje kandi rimwe na rimwe bifite ubushishozi, ibyo ikora mubyukuri ni ugukina umukino ushimishije wuburyo bushoboka. Ibisobanuro? Iyo hari ikintu gishya kiza (nkimpapuro nshya-yubumenyi yubumenyi kuri kwantike ya kwantike cyangwa inganda zimwe na zimwe za jargon), biragoye kubyumva neza.

Ntabwo ... ibara.

Tegereza. Ariko Kuki bidashobora kuba rusange nkabantu?

Noneho, dore aho abantu batandukanye cyane nimashini. Tekereza urimo usoma igitekerezo kirenze ubuhanga bwawe bwa mbere. Birashoboka ko uri umushinga watangije tekinoroji uyobora isi yubukanishi. Nukuri, ntushobora guhuza utudomo twose kubisomwa bwa mbere - ariko nyuma yo kwitegereza ingero zingero cyangwa igishushanyo, amatara amwe amwe azimya. Aha, iyi ni sisitemu yo kugenzura! Ibi bihuza nibyo! Hanyuma, dore, urabibona (cyangwa byibuze ibyinshi).

Iyi nuance yitwa isasu rimwe-rusange - ubushobozi bwo gufata vuba imiterere cyangwa gusobanukirwa amakuru mashya rwose ashingiye kuburorero buke. Kandi nikintu abantu bafite ubuhanga budasanzwe. Dufata agace gato k'ubumenyi kandi tugashushanya ku buryo bugaragara ku nsanganyamatsiko yagutse, imiterere, cyangwa ibigereranyo dusanzwe tuzi. Muyandi magambo, ntidukeneye ingero miriyoni cyangwa corps nini yamakuru yashize kugirango tugire epiphany.

Ibinyuranye cyane, ibyitegererezo bibyara ntabwo byumva isi yose. Bagenda-banyuze mumwanya wibarurishamibare kandi batanga ubuhanuzi bushingiye kumagambo cyangwa imiterere ishobora guhurira hamwe. Iyo rero basabwe gukora ikintu gishya rwose - ijambo rishya rya siyansi rwose, igitekerezo gishya ntabwo cyigeze gisohoka kumurongo - bayobora umutwe murukuta. Muri make, ntibigeze bahura nabyo mbere , kandi ntibabura uburyo nyabwo bwo gutekereza kugirango basimbuke kubutaka butamenyerewe.

Nibyiza, ibyo ni abstract. Reka ndeke kubisenya.

Moderi ya AI ikora yiga muguhuza hagati yamakuru ariho. Ibisobanuro, bahinduka abahanga mukuzuza icyuho kiri hagati yingingo bamaze kubona nuburyo bamenyereye, ariko bakarwana na extrapolation , ni ukuvuga gusimbuka no gukora ibishushanyo bishingiye ku gitekerezo gishya mugihe amakuru yimyitozo adafite urugero. Kurugero, GPT-4 irashobora gukora "bisanzwe" imyubakire yindimi mururimi rwa burimunsi kuko hariho ingero za miriyoni ziboneka. Ariko, tera icyifuzo cyo kuvuka, hyper-yihariye ibitekerezo - vuga, umwihariko witerambere ryambere muri solitonic fibre laseri muri physics - na boom: gibberish absolute. Kubera iki? GPT ntabwo ifite imibare yerekana imibare nkiyi, amagambo mashya. Byibanze byize gukeka ko, nubwo bishoboka kuvuga neza, bitanga igitambo nyacyo kugirango gikosorwe .

Tekiniki ya tekinike yikibazo

Nibyiza, niba ufite ibitekerezo byubuhanga buke, reka twibire cyane kubwimpamvu iyi ntambamyi yinangiye, nibibera munsi yumutwe mugihe cyo kugerageza rimwe.

Ikibazo kimwe nyamukuru hamwe no kurasa rusange ni kubijyanye namakuru icyitegererezo cyerekana imbere mugihe cyamahugurwa yiyobora . Imiterere ya GPT yimyitwarire myiza mugihe ikora mumipaka - ibintu bikunze gusobanurwa nko mukwirakwiza kwigira . Mu mbibi zinsanganyamatsiko yabonye ingero nini zamahugurwa ahagije, ndetse na GPT-4 irashobora gukuramo ibisubizo byubushishozi. Ibi ni ukubera ko imiterere yicyitegererezo ituma ibika amakuru ikoresheje ibishushanyo mbonera byerekana - muburyo bwo gushira hamwe - bifata amashyirahamwe hagati yamagambo nibitekerezo.

Ariko hano niho ibintu bihishurira. Iyo icyitegererezo gihawe nikibazo gisaba kutagabanywa muri rusange, bivuze guhura nigitekerezo kitigeze gitozwa mbere, sisitemu ntisobanura ibintu nkuko abantu babikora. Bitekerezeho gutya: izi moderi ni imashini zerekana imiterere, zishingiye ku mibare "ibyiyumvo byo mu nda." Ntabwo bafite ubushobozi bwubaka bwo gukora cyangwa gutekereza "hejuru yamakuru."

Kurugero, suzuma uburyo GPT yiga amategeko yikibonezamvugo. Ninkumuntu wicaye gufata mu mutwe inzira ibihumbi nibihumbi amagambo akoreshwa mumagambo yicyongereza. Nyuma yo kwitegereza bihagije, sisitemu yubaka ikarita yimbere izi, "Ah, nyuma yikintu kiza inshinga, hanyuma wenda ikintu, hanyuma ukajugunya mu ngingo cyangwa intangiriro nkuko bikenewe." Ariko iyo yerekanwe nururimi rushya cyangwa imiterere yinteruro nshya, ubwo bushobozi burahungabana kuko bugarukira gusa kumenya umubano wihishe (cyangwa utagaragara) umaze kubona.

Ikibabaje, gifite aho kigarukira. Fata akazi aho byakenerwa kubyara inyandiko ihuje kubyerekeye ikintu kidasobanutse, vuga ibintu byavumbuwe mubintu bike bizwi na fiziki nka kwant-gravity duality . Icyitegererezo kibuze guhimba gisabwa kugirango dusobanure ubumenyi bwakera kugirango tumenye ibishoboka bishya. Mu bwonko bwacu bwabantu, burigihe dufite urwego rwohejuru rwerekana (ibitekerezo, inyigisho, ibigereranyo!) Biduha guhinduka. GPT, nubwo, ntabwo! Itanga ibisubizo bishingiye ku guhanura gushoboka , ntabwo gusimbuka guhanga.

Birasa no gutwara ikarita yateguwe mbere yinzira zo mu kinyejana gishize: ntabwo igufasha kugendagenda kubakwa cyangwa kunyura mubyerekezo byagaragaye mumezi atandatu ashize.

Kubona Tekiniki - Impamvu Ibi Bibaho Munsi ya Hood

Intambwe imwe igana ku gusobanukirwa aho igarukira ni ukumenya uruhare rwikigereranyo vs gake .

Ndashaka kuvuga iki?

Imiterere ya transformateur gakondo ikorana na vector yuzuye . Buri kimenyetso mu nteruro kigereranwa n’ibice byo hejuru, kandi ibyo bice bifata umurongo mugari wubusabane hagati yamagambo - imiterere yubukorikori, ibisobanuro bisobanura, imbaraga za posisiyo, nibindi. Ariko kubera ko ibyo bihagararirwa ari byinshi, ntibitandukanijwe bihagije kugirango bishyigikire abstraction muburyo buganisha kuri rusange.

Gushyiramo ubucucike bigarukira kubogama-gutandukanya ibicuruzwa mugihe cyamahugurwa yicyitegererezo. Uku gucuruza ni ngombwa: mugutezimbere ikintu kimwe (ubushobozi rusange bwibarurishamibare), icyitegererezo gitanga ikindi kintu (ubushobozi bwo gutekereza mubihe bishya rwose). Tekereza uhora uhuza imitekerereze yawe kugirango uhuze neza nisi umaze kubona; gucuruza ni uko ibintu bitateganijwe biguta kure. Ingero zishingiye ku mibare zikomeye ariko zisanzwe zisanzwe zirwanya imanza ntoya imwe kuko ziza cyane mu gusubiramo “impuzandengo” kandi igahagarara imbere y’ibidasanzwe ku mategeko yize.

Igisubizo cyingenzi gishobora kuboneka hano ni gake cyane - tekinike yo gukora ibipimo bitandukanya ibintu bitandukanye murwego rwo gusobanura. Imiyoboro idahwitse yerekana kandi igarura amakuru muburyo bworoshye kandi rusange, nkuburyo abantu bibanda kubintu byingenzi, byingenzi muguhitamo ibizagerwaho aho guhangayikishwa nibintu bito.

Ikibazo kimwe rero cyo kurasa rusange ni uko imiterere y'urusobe rugezweho rudashimangira imirimo nk'iyi yo gutandukana - bashingira cyane ku buryo bwuzuye, bushingiye ku makuru. Niyo mpamvu, iyo, iyo usabwe guhuriza hamwe ibintu bishya kandi byihariye hamwe nibintu bito, birananirana.

Ni iki gishobora gukemura iki?

Kubwamahirwe, ntabwo tuvuye mubitekerezo. Abashakashatsi ba AI (nanjye ndimo!) Batangiye gutanga ibitekerezo kuburyo butandukanye bwo kunoza ubushobozi bwa AI bumwe. Bumwe muburyo bushishikaje buzenguruka meta-yiga imyubakire. Iyi myubakire iratandukanye cyane nicyitegererezo cyiki gihe, ituma ubushobozi bwo kwiga-bwo-kwiga ubushobozi aho sisitemu ihinduranya ibipimo byayo kugirango ihuze ubwoko bushya bwamakuru byihuse - cyane cyane bijyanye nimyitwarire isa nabantu.

Muri Model-Agnostic Meta-Kwiga (MAML) , kurugero, icyitegererezo cyihindura kugirango cyige imirimo mishya hamwe nurugero ruto rwo guhugura. Memory-Augmented Neural Networks (MANNs) ikora kimwe no kugumana imiterere yize mubihe byinshi, bisa nkukuntu twibuka amasomo yingenzi kuva kera kandi tukayakoresha byimazeyo mugihe duhuye nibintu bishya, bisa.

Kwinjiza ubushobozi bwikigereranyo bwo gutekereza muburyo bwimbitse bwo kwiga nubundi buryo butanga ikizere. Icyitegererezo gifite ibikoresho byikigereranyo gishobora 'gutekereza' binyuze muri logique, aho gushingira gusa kumibare yuzuye. Imirima nka Neuro-Symbolic AI itanga imvange yuburyo bwo guhuza hamwe na sisitemu ishingiye ku mategeko yemerera AI kwigana imitekerereze yo mu rwego rwo hejuru, cyane cyane mubitekerezo bidafatika.

Inzira Imbere?

None se ibyo byose bivuze iki kubihe bizaza bya AI? Nukuri, GPT-4 yumva ari amarozi mugihe iduha imikoranire myiza yabakiriya cyangwa igasubiza ibibazo bisanzwe, ariko dukeneye guteza imbere imiterere itari moteri yo gufata mumutwe gusa. Twerekeje ahazaza aho kwimura imyigire , meta-kwiga , hamwe na neuro-bigereranya imyubakire ihurira hamwe kugirango habeho abiga guhuza n'imihindagurikire.

Ihuriro rimwe-Rusange Paradox ntabwo apocalyptic apfuye kuri AI. Nimbogamizi ituma twongera gutekereza kubitekerezo byingenzi byerekeranye n'ubwenge no guhinduka. Nkuko amakuru yonyine atazakosora ibi - moderi izakenera ubushobozi bwo kwigira kubikururwa , gukora ibigereranyo , no kwibuka ibintu byingenzi , ntabwo gufata mumutwe gusa.

Icyitegererezo cyacu kizaza kizakenera kuba abantu kuruta imashini mugihe kijyanye n'ubumenyi. Nkabashakashatsi, abitezimbere, nabashya mugace, turacyari muburyo bwambere bwo gusobanura icyo AI yiga - ubwayo - mubyukuri byoroshye, bishya.

Ntabwo ari ikibazo cya tekiniki gusa. Ni filozofiya.