Ubhalo lwakho lunophawu lweminwe-kwaye lo mzekelo wokusika we-AI unokuwubona

Itheyibhile yoQhagamshelwano

Isishwankathelo kunye ne-1 Intshayelelo kunye nemvelaphi

I-2 ye-Statistical Parsing kunye ne-Extracts Features

Iimpawu ezi-3 zePase Tree

4 Umdidi

5 UkuNcitshiswa koMda

6 Amaphepha eFederalist

6.1 Sanditon

7 Izigqibo, Ingxubusho kunye noMsebenzi Wexesha elizayo

A. Intshayelelo emfutshane yoPhando loBalo

B. Ukucuthwa koMda: Ezinye iiNkcukacha zeMathematika

Iimbekiselo

Abstract

Ukutyhubela iminyaka bekukho umdla oqhubekayo wokufumana ubuqambi besicatshulwa ngokusekwe kwiimpawu zobalo zesicatshulwa, njengokusebenzisa amazinga okwenzeka kwamagama angengomxholo. Kumsebenzi wangaphambili, obu buchule busetyenzisiwe, umzekelo, ukumisela ububhali bawo onke amaPhepha eFederalist. Ezo ndlela zinokuba luncedo kumaxesha anamhlanje ukufumana ubunyani bobuxoki okanye be-AI. Inkqubela-phambili kumanani abacazululi bolwimi lwendalo yazisa ukuba nokwenzeka kokusetyenziswa kwesakhiwo segrama ukukhangela ubuqambi. Kweli phepha siphonononga into entsha enokwenzeka yokubhaqa ubuqambi sisebenzisa ulwazi lwegrama yolwakhiwo olucatshulwe kusetyenziswa umcazululi wolwimi lwendalo ngokwamanani. Eli phepha libonelela ngobungqina bengqikelelo, ulwahlulo lombhali oluvavanyayo olusekwe kulwakhiwo lwegrama kwiseti "yemibhalo yobungqina," I-Federalist Papers kunye neSanditon eziye zaba ngamatyala ovavanyo kwizifundo zobhaqo zangaphambili. Iifitsha ezininzi ezithatyathwe kuluhlu lolwimi lwendalo lwezibalo ziye zajongwa: yonke imithana yobunzulu obuthile ukusuka kulo naliphi na inqanaba; iingcambu ezisezantsi zobunzulu obuthile, inxalenye yentetho, kunye nenxalenye yentetho ngokwenqanaba kumthi wokwahlulahlula. Kwafunyaniswa ukuba luncedo ukwenza iprojekti yeempawu kwindawo ephantsi yomgangatho. Imifuniselo yamanani kula maxwebhu ibonisa ukuba ulwazi olusuka kumculi weenkcukacha-manani lunokuthi, enyanisweni, luncede ekwahluleni ababhali.

1 Intshayelelo kunye nemvelaphi

Kubekho umzamo omkhulu kule minyaka unxulumene nokusetyenziswa kweendlela zobalo ukuchonga ubuqambi beetekisi, ngokusekwe kwimizekelo evela kubabhali abagqatswa, kwinto maxa wambi ebizwa ngokuba “yi-stylometry” okanye “ukuchonga umbhali.” Uhlalutyo lwamanani lwamaxwebhu lubuyela ku-Augustus de Morgan ngo-1851 [1, p. 282], [2, iphe. 166], owacebisa ukuba iinkcukacha-manani zobude begama zingasetyenziswa ukumisela ububhali beeleta zikaPauline. I-stylometry yasetyenziswa kwango-1901 ukuhlola ububhali bukaShakespeare [3]. Ukususela ngoko, isetyenziswe kwiintlobo ngeentlobo zezifundo zoncwadi (bona, umz. Ubuchule bolwazi lwethiyori busetyenziswe mva nje [8]. Umsebenzi wangaphambili kwi-stylometry usekwe "kumagama angekho nomxholo," amagama angayidluliseli intsingiselo ephambili yesicatshulwa, kodwa asebenza ngasemva kwesicatshulwa ukunika isakhiwo kunye nokuhamba. Amagama angekho nomxholo ubuncinane ayavakala, kuba umbhali enokuthetha ngezihloko ezahlukeneyo, ngoko ke amagama athile awahlulayo akabonisi ukuba ngumbhali. Kuphononongo lwamagama angengowomxholo, kuseti yamagama amaninzi aqhelekileyo angekho nomxholo okhethiweyo [2], kwaye amaxwebhu amelwe ngokubalwa kwamagama, okanye umlinganiselo wokubalwa kwamagama kuxwebhu lobude. Uphononongo lweendlela zobalo lukwi [9]. Njengotshintsho, iiseti zereyishini zamanani eepateni zamagama angengomxholo ukuya kwezinye iipateni zamagama nazo ziyasetyenziswa [10]. Uhlalutyo lweenkcukacha-manani olusekwe kubukhulu besigama sombhali ngokuchasene nobude boxwebhu - "ubutyebi besigama" - buye baphononongwa [11]. Ngomnye umsebenzi onxibeleleneyo, bona [12, 13, 14, 15]

Iphepha lakutshanje [16] liqwalasela ukusebenza kweentlobo ezininzi zeeseti zeempawu. Iiseti zeempawu ezithathelwa ingqalelo apho ziquka: ii-vectors ezibandakanya ukuphindaphindwa kwezimelabizo; amagama asebenzayo (oko kukuthi, amanqaku, izimelabizo, amasuntswana, iziqhulo); inxalenye yentetho (POS); awona magama aqhelekileyo; iimpawu zesintaksi (ezifana nebinzana lesibizo, okanye ibinzana lesenzi); okanye ixesha (umz. ukusetyenziswa kwexesha langoku okanye eladlulayo); ilizwi (elisebenzayo lesenzo sokwenziwa). Kwi- [16], i-vectors ye-feature yenziwa ngokudibanisa i-histograms, emva koko iyancipha kwi-dimensionality isebenzisa inkqubo yesigaba esibini sohlalutyo lwecandelo lomgaqo-siseko [17] elandelwa kukunciphisa umlinganiselo kusetyenziswa uhlalutyo olucalulweyo olucacileyo (LDA). Kwi-LDA yabo, i-matrix ye-scatter yangaphakathi ikwisinye (ngenxa yobukhulu obuphezulu beempawu ze-vectors ezihambelana nenani lee-vectors zoqeqesho ezifumanekayo), ngoko ke i-matrix yabo yokuchithachitha imiselwa rhoqo. Ukuvavanya oku, ababhali bathathela ingqalelo uluhlu lweeparamitha zokumisela, bekhetha enye enika owona msebenzi ubalaseleyo.

Umsebenzi wakutshanje ngakumbi [18] ukhankanya uphando [15] apho iimpawu ezisetyenziswa ngokuqhelekileyo kwinkalo yokubhala igama kunye nomlinganiswa n-grams. Njengoko kuphawuliwe, kukho imingcipheko iindlela zeenkcukacha-manani ezinokuthambekela ecaleni ngokweepateni ezinxulumene nesihloko. Njengoko [18] ephawula, “umdidi wombhali (nokuba ubonakala ulungile) unokuphelela engenzi ngabom ukuchonga isihloko ukuba iimpawu ezixhomekeke kwindawo ziyasetyenziswa. ... Ukuze uthintele oku, abaphandi banokunciphisa umda wabo kwiimpawu ezicacileyo ze-agnostic, ezifana namagama asebenzayo okanye iimpawu ze-syntactic." Umsebenzi othiwe thaca apha uwela kudidi lokugqibela, kusetyenziswa izakhiwo zegrama ezicatshulwe kwisicatshulwa. Ezi zibonakala kunzima ukuzibhaqa. Uvavanyo lweminye imisebenzi yakutshanje [19, 20] lubonisa ukuba kukho umdla oqhubekayo kwiindlela zokuchongwa kwababhali, kodwa akukho namnye osebenzisa izakhi zegrama ezisetyenziswa apha; kukho utyekelo lokuthembela ngakumbi kwii-n-grams zemveli.

Kulo msebenzi iimpawu zevekhtha zifunyanwa kusetyenziswa ulwazi lomthi olusuka kwipase yemithi ukusuka kwisixhobo sokwahlulahlula ulwimi lwendalo [21]. Ezi mpawu bezingekho phakathi kweempawu eziqwalaselwe [16]. Ulwakhiwo lwegrama, lubonakala lufihlakeleyo kunezibalo ezilula zeendidi zamagama, kwaye ngenxa yoko zisenokungaxhomekeki kwi-spoofing okanye ukuthambekela kwesihloko, kuba kubonakala ngathi akunakwenzeka ukuba umbhali onenjongo yokulinganisa omnye angakwazi ukulandela ngokuhambelanayo iipateni ezintsonkothileyo zokusetyenziswa, kwaye iimpawu azibandakanyi nawaphi na amagama avela kumaxwebhu. Kufunyaniswa ukuba iimpawu ezisekelwe kumthi zenza ngcono kuneempawu ze-POS kwidatha yovavanyo eqwalaselwayo.

Iimpawu ezifunyenweyo zinokuba nomgangatho ophezulu kakhulu, ngoko ke ukuncitshiswa komda kuyakwenziwa apha. Nangona kunjalo, ukujongana nobunye be-matrix yokuchithachitha ngaphakathi kweqela, kusetyenziswa indlela ye-SVD eqhelekileyo, ethintela isidingo sokukhetha iparamitha yokumisela.

Eli phepha libonelela ngobungqina bobungqina bezi mpawu zisekelwe kwimithi ukwahlula ububhali ngokuzisebenzisa kumaxwebhu ahlolwe ngaphambili, i-Federalist Papers kunye ne-Sanditon. Ubuchule bokuhlela ngobuqambi buphononongwa kwiivektha ezininzi ezifunyenwe kulwazi olucazululiweyo.