paint-brush
AI's Non-Determinism, Hallucinations, na ... Injangwe?na@alexandersimonov
Amateka mashya

AI's Non-Determinism, Hallucinations, na ... Injangwe?

na Alexander Simonov6m2025/02/16
Read on Terminal Reader

Birebire cyane; Gusoma

AI ni nk'injangwe: rimwe na rimwe zirarya, rimwe na rimwe zikirengagiza, kandi rimwe na rimwe ziragushushanya. Ibisubizo bya ChatGPT biva muburyo bukomeye aho kuba itegeko rikomeye. Ikunda kwishakamo ibisubizo byayo kandi yizewe gusa iyo ikoreshejwe murwego rukwiye.
featured image - AI's Non-Determinism, Hallucinations, na ... Injangwe?
Alexander Simonov HackerNoon profile picture
0-item
1-item

Igihe kinini, inzobere mu by'ikoranabuhanga zakoze zititaye ku isi. Bateje imbere, bubaka, kandi bohereza software neza. Noneho igihe cyo kwigunga cyakubiswe, kandi mu buryo butunguranye, bararambiwe (birumvikana ko iyi ari ugukina ibintu bifatika). IT abantu bashakaga gukora ikintu gishobora gukora akazi kabo mugihe bagumye murugo: subiza ibibazo bisanzwe, kubyara avatar nziza, no gusesengura amakuru menshi muminota. Barose gutembera ahantu heza, nuko, urakeka, bahinduye AI.


Ubu AI irakora, itanga ibisubizo, kandi itezimbere ubuzima. Nka umufasha kabuhariwe nkuko biri, AI ikora neza gusa iyo ikoreshejwe murwego rukwiye.


Turimo kwibonera iterambere ryihuse mubikorwa bya AI, kuva amashusho na videwo kugeza kumasoko yimigabane no gusesengura amafaranga. Nyamara, AI irashobora gutanga amakuru tutabaza cyangwa gutanga ibisubizo byibinyoma. Imyitwarire yayo irasa cyane ninjangwe zo murugo - urabizi, ubwoko bwicaye bucece hanyuma bukaguhita bukubitiraho?


ChatGPT iyo ubajije ikibazo cyoroshye


Injangwe zacu, kimwe na AI, zishimira kuba zitateganijwe:


  • Urabaha ibiryo bimwe (cyangwa data) - rimwe na rimwe bararya, rimwe na rimwe bakabyirengagiza.
  • Urabatoza gusubiza, ariko rimwe na rimwe barabyitabira iyo ubahamagaye.
  • Ninini ninjangwe ninjangwe cyangwa nini ya moderi ya AI, biragoye guhanura imyitwarire yayo.
  • Mu gitondo, injangwe zishobora gutuza; nimugoroba, bahindura hyperactive (nkamakuru yingirakamaro).
  • Injangwe zishobora kuba inshuti (deterministic) ariko zirashobora kugushushanya utaburiye (stochastic).


Urashobora kwibaza icyo determinism hamwe no kwinangira bisobanura - reka tubimenye.

Kwiyemeza no Kwinangira

Sisitemu ya deterministic buri gihe itanga ibisubizo bimwe byatanzwe kimwe - tekereza idempotency niba uri injeniyeri ya DevOps . Urugero nyarwo rwaba injangwe yawe irya ibiryo bingana washyize mubikombe byayo igihe cyose - iyi ni determinism . Ariko iyo injangwe ihumura ikarya kimwe cya kabiri gusa, ntabwo iba ikigena.


Ibiteganijwe gusohoka (igikombe cyubusa) nibisohoka mubyukuri


Inzira itajenjetse ikubiyemo ikintu cyo guhitamo: hamwe ninjiza imwe, ibisubizo birashobora gutandukana. Kurugero, imashini yiga imashini akenshi ikoresha algorithm ya stochastic, nka Stochastic Gradient Descent (SGD) , itoza icyitegererezo mugutoranya uduce duto twamakuru aho gukoresha imibare yose.


Ibi bisobanuro ntibisobanura neza impamvu AI yacu rimwe na rimwe yerekana kandi ikitwara nabi. Hariho ibindi bintu bitanga umusanzu, harimo ibi bikurikira:


  • Kwiyemeza
  • Kwinangira
  • Kuzenguruka amakosa no kureremba-ingingo y'imibare
  • Gusoma byinshi hamwe no kubara
  • Gukomeza kuvugurura amakuru
  • Akajagari n '“ikinyugunyugu”


Niba turebye hafi, tuzabona ubundi buryo bugira ingaruka kumyitwarire idateganijwe ya moderi ya AI.

A Glimpse of Neural Networks

Ushobora kuba uzi ko AI buriwese akoresha yishingikiriza kumurongo utandukanye wa algorithms. Hano hari ubwoko bumwebumwe bwimiyoboro:


  • Imiyoboro ihamye yuzuye (FCNN): Ubwubatsi bwa kera aho buri neuron ihuza na neuron yose murwego rukurikira.


  • Imiyoboro ya Neural Network (CNNs): Iyi miyoboro ikoresha imyanzuro cyangwa akayunguruzo kagaragaza ibiranga ishusho nkimpande, imiterere, na shusho.


  • Imiyoboro ya Neural Isubiramo (RNNs ): Iyi miyoboro ifite ibitekerezo byisubiramo bibafasha kwibuka intambwe zabanjirije (aribyo, bibuka uko byakurikiranye).


  • Ububiko Bwigihe gito (LSTM): verisiyo yongerewe ya RNNs hamwe nuburyo bwo guhitamo kwibagirwa no kwibuka amakuru yingenzi.


  • Abahindura : Icyiciro gikomeye cyane cyo gutunganya inyandiko. Bakoresha imitwe myinshi, ibemerera gusuzuma icyarimwe icyarimwe.


  • Imiyoboro rusange ya Adversarial Network (GANs): Igizwe n'imiyoboro ibiri, imwe itanga amakuru indi igasuzuma ubuziranenge bwayo. Irushanwa ryabo riganisha ku bisubizo byiza.


  • Autoencoders : Imiyoboro yagenewe guhuza amakuru (kodegisi) hanyuma ikongera ikubaka (decode).


  • Graph Neural Networks (GNNs): Bakorana nishusho (node nu mpande) aho gukora amakuru asanzwe.


Dukeneye ibyaribyo byose kugirango twumve impamvu moderi ikunze kugaragara, ChatGPT, akenshi yerekana.

Ukuntu AI Hallucinations ibaho

ChatGPT ikora ku bwubatsi bwa Transformer , yatangijwe bwa mbere mu mpapuro za 2017, "Icyitonderwa nicyo ukeneye." Ubu ni bwo buryo bwahinduye gutunganya inyandiko. Abahinduzi bakora muburyo bwo kwiyitaho, bubafasha gusuzuma imiterere yisi aho gutekereza gusa kumagambo yegeranye nkurusobe rwimitsi rusubirwamo (LSTM na GRU) bakora. Icyitegererezo ni icya GPT (Generative Pre-Trained Transformer) ikurikirana, bivuze:


  • Yabanje gutozwa: Yabanje gutozwa kubwinshi bw'inyandiko (ibitabo, ingingo, imbuga za interineti, na kode).
  • Ibisekuruza: Inshingano zayo nugukora inyandiko, ntabwo ari ugushyira mubikorwa cyangwa gukuramo ibintu gusa.


Ibisubizo bya ChatGPT biva muburyo bukomeye aho kuba itegeko rikomeye. Ntabwo ifata mu mutwe cyangwa ngo isubiremo inyandiko ariko itanga ibisubizo ukoresheje icyitegererezo gishoboka.

Guhanura Ijambo nkibikorwa bishoboka

Iyo ChatGPT isubije, ntabwo ihitamo ijambo rimwe ryukuri ahubwo riharura ikwirakwizwa rishoboka.


P (wi | w1, w2, ..., wi-1), aho:

  • “Wi” - ijambo rikurikira mu nteruro

w1, w2, ..., wi-1 - amagambo yabanjirije

  • P (wi | w1, ..., wi-1) - birashoboka ko "wi" izaba ijambo rikurikira


Kurugero, niba ubajije, “Uyu munsi ni uwuhe munsi?” ChatGPT ishobora kuba ifite amahirwe atandukanye:


  • “Ku wa mbere” - P = 0.7
  • “Ku wa gatatu” - P = 0.2
  • “42” - P = 0.0001


Bizahitamo cyane cyane ijambo hamwe nibishoboka cyane, ariko bitewe nubushyuhe bwibisekuru (ibipimo bigenzura ibintu), birashobora rimwe na rimwe guhitamo uburyo bushoboka bushingiye kumiterere.

Imirongo Ingaruka no Kwibagirwa Amakuru

ChatGPT ikorana nidirishya rito, bivuze ko "yibuka" ibimenyetso bya NN byanyuma. Kuri GPT-4, idirishya ryibanze ni hafi ya 128k ibimenyetso (impapuro 300 zanditse). Niba amakuru yingenzi ari hanze yiki gice, irashobora:


  • Wibagiwe ibisobanuro (ingaruka zo gukuramo imiterere)
  • Amakuru yo kwisiga (inzira idakuka)


Nyamara, ChatGPT irashobora gukosora igisubizo cyayo nyuma yo kubaza niba aribyo. Ariko, ChatGPT irashobora gukosora igisubizo cyayo niba ubajije niba aribyo.

AI Rimwe na rimwe ikosora ubwayo, ariko kubera iki?

Iyo ubajije ChatGPT, “Urabyizeye?” isubiramo igisubizo cyayo ikoresheje imiterere mishya aho gushidikanya bihari. Ibisubizo muri:


  • Kongera kubara ibisubizo bishoboka.
  • Guhitamo uburyo bushoboka niba umwe abaho.


Iyi nzira irashobora gusobanurwa nibishoboka bya Bayesian.


P (A | B) = P (B | A) P (A) / P (B), aho:


  • P (A | B) - ibishoboka gusubiza A ni byo, urebye ikibazo cyawe cyo gukurikirana B.

  • P (B | A) - birashoboka ko wabajije niba ChatGPT yabanje kuvuga ukuri.

  • P (A) - ibishoboka byambere igisubizo cya ChatGPT.

  • P (B) - muri rusange bishoboka ko wabaza.


Amakuru menshi kuri wewe? Ubushyuhe bukabije mu bwonko? Tekereza ko AI nayo irengerwa namakuru menshi.

Amakosa Kubera Kurenza urugero kandi Urusaku rwamakuru

Umubare munini wamakuru yinyandiko yinjira mumahugurwa ya ChatGPT, harimo urusaku cyangwa amakuru avuguruzanya, nka:


  • Inkomoko zimwe zivuga ko Isi izengurutse, mu gihe abandi bavuga ko iringaniye.


  • AI ntishobora kumenya buri gihe amakuru nukuri mugihe igaragara hamwe nibishoboka bitandukanye.


ChatGPT gutunganya amakuru avuguruzanya kuba nka


Izi nizo ngero za salusiyo yerekana, bibaho kubera ko uburemere bwa ChatGPT bwatojwe kumashyirahamwe yamagambo aho kuba logique ikomeye.

Umurongo w'urufatiro

Dore ibyo dushobora kwigira kuriyi. ChatGPT yerekana kuva aho:


  • Ihanure bishoboka, ntabwo igenekereje.

  • Ifite ububiko buke (idirishya ry'imiterere).

  • Ongera usuzume ibishoboka iyo ubajijwe.

  • Ifite amakuru yo guhugura arimo urusaku no kwivuguruza.


Nibyo. Nizere ko utarushye. Niba warabikoze, icyo ni ikimenyetso cyiza kuko bivuze ko utekereza neza, nibyo rwose tugomba gukora mugihe dukorana na AI.

L O A D I N G
. . . comments & more!

About Author

Alexander Simonov HackerNoon profile picture
Alexander Simonov@alexandersimonov
Alexander Simonov is the Deputy DevOps Practice Lead at Coherent Solutions. He has written bylines for DZone, The New Stack, and is a 2024 DevOps Dozen Award honoree, recognized by DevOps.com.

HANG TAGS

IYI ngingo YATANZWE MU...