Riba:
- Fahimtar yadda RAG (raguwa, samun dama, tsarar da ke dogaro da albarkatu) ke aiki da yadda yake rage hallucination
- Ikon haɓaka ingancin amsoshi ta hanyar kafa tushen ilimi wanda yake a halin yanzu, bayyananne, ba tare da rikici ba kuma yana da tushe guda ɗaya daidai.
- Ikon koyar da samfurin 'idan ba a cikin tushen ba, gaya mani ba ku sani ba' kuma juya tambayoyin da ba zai iya amsawa zuwa ingantaccen tushe na ilimi ba.
Amsar da bot ko wakili mataimakin ya bayar tana da kyau kamar bayanin da aka dogara da shi. Lokacin da abokin ciniki ya tambayi "Shin yakin yana ci gaba?", amsar daidai ba a cikin ƙwaƙwalwar ƙirar ba, amma a cikin tushen ilimin yanzu na cibiyar. Shi ya sa zuciyar cibiyar kira ta wucin gadi ita ce tushen ilimi (KB): kayan aiki na yau da kullun inda samfuran, manufofi, FAQs, hanyoyin da dokoki ke adana a rubuce. Kuma hanyar da ta haɗe wannan tushen ilimin da hankali na wucin gadi ana kiranta RAG: Retrieval-Augmented Generation - maimakon yin amsa daga ƙwaƙwalwar ajiyarsa, ƙirar ta fara dawo da abubuwan da suka dace daga tushen (dawo) sannan ya haifar da amsar dangane da waɗannan guntu kawai (ƙarni).
RAG ita ce hanya mafi ƙarfi ta hana hallucination. Samfurin ba ya haifar da lamba a kansa don tambayar "menene ƙimar lamuni?" Yana maido da rubutun sha'awa na yanzu daga tushe na ilimi kuma yana ba da amsa akansa. A cikin wannan rukunin za mu ga yadda za a kafa tushen ilimin, yadda RAG ke aiki da kuma yadda ingantaccen tushen ilimi ke ƙayyade ingancin amsoshi.
Yadda RAG ke aiki: matakai hudu
Yi tunanin RAG kamar ma'aikacin ɗakin karatu. Abokin ciniki yana yin tambayoyi; Na'urar ta fara nemo shafukan da suka dace daga daidaitaccen ɗakin karatu, sannan ya karanta waɗannan shafuka kuma ya rubuta amsar. Matakan fasaha sune kamar haka:
- Chunking: Dogayen takaddun da ke cikin tushen ilimin sun karye zuwa ƙanana, guda masu ma'ana (misali, kowane FAQ guntu ne). Domin samfurin yana amsa tambaya daidai da ƙananan sassa masu alaƙa.
- Ƙirƙira da ƙididdigewa: Ana fassara kowane yanki zuwa nau'i na ƙididdiga wanda ke wakiltar ma'anarsa (saɓawa-jerin lambobi masu wakiltar ma'anar rubutu) kuma an sanya su a cikin ma'aunin bayanai. Don haka, ba “daidaita kalma ba ce” amma “ma’anar ma’ana”; Ko da abokin ciniki ya tambaya "yaushe za a ajiye kuɗina?", ana iya samun ɓangaren "lokacin dawowa".
- Maidowa: An dawo da sassan mafi kusa da ma'ana ga tambayar abokin ciniki (misali mafi kusa 3-5 sassa).
- Generation: Samfurin yana rubuta amsar bisa ga sassan da aka zana KAWAI kuma yana nuna tushen idan zai yiwu.
Mahimmin mahimmanci yana cikin mataki na 4: an umurci samfurin don "kawai dogara ga guntuwar da aka bayar, ko kuma ku ce ba ku sani ba." Idan ba tare da wannan umarnin ba, RAG baya hana samfurin dacewa.
Alamomi: Dokar zinariya ta RAG: "Idan ba a cikin tushen ba, babu amsa." Kyakkyawan tsarin RAG zai ce "Ban san tabbas game da wannan ba" ga tambayar da ba ta cikin tushen ilimi; baya cika gibin da zato. Ƙarfin bot na faɗin "Ban sani ba" fasalin tsaro ne, ba rauni ba.
Kyakkyawan tushe na ilimi: ainihin tushen ingancin amsa
Duk yadda RAG yake da kyau, idan tushen ilimi ba shi da kyau, amsar ba ta da kyau. Ana auna ingancin tushen ilimi ta:
fasali
tushen ilimi mara kyau
Kyakkyawan tushe na ilimi
Yanzu
Ba a sabunta shi tsawon watanni
Ana sabuntawa nan da nan lokacin da aka canza
Tsaratarwa
Dogon rubutu mai ruɗi
Gajerun labarai, jigo guda
tsari
Tulin PDF mara kyau
Labeled abubuwa masu lalacewa
Daidaitawa
Amsoshi biyu masu karo da juna
Tushen gaskiya guda ɗaya
Iyakar
Akwai gibi da yawa
Yana rufe tambayoyin da ake yawan yi
mallaki
Babu wanda ke da alhakin
Kowane batu yana da mai shi
Matsala mafi haɗari a cikin mahallin cibiyar kira shine sabani: idan an rubuta lokutan dawowa daban-daban guda biyu a cikin tushen ilimin, RAG zai faɗi duk wanda ya ɗauka kuma za a aika da amsa mara daidaituwa ga abokin ciniki. Shi ya sa ka’idar “tushen gaskiya daya” ke da matukar muhimmanci: ana adana bayanai a wuri guda; Ana amfani da nassoshi zuwa wannan tushen, ba kwafi ba.
Mataki-mataki: gina tsarin amsawa mai goyan bayan RAG
- Tsaftace tushen ilimin: Cire abubuwan da suka gabata, masu karo da juna, kwafi. Sanya kowane labarin gajere kuma jigo ɗaya.
- Rage shi kuma yi masa alama: Ƙara alamar jigo da kwanan wata sabuntawa ta ƙarshe ga kowane labarin.
- Ƙirƙiri hanyar shiga: Haɗa hanyar da ke jan sassa masu dacewa lokacin da aka tambaye su (kayan aikin RAG na kamfani sun samar da wannan).
- Rubuta tsattsauran hanzari: Faɗa samfurin "doga kawai ga sassan da aka bayar, buga tushen, ko ka ce ba ku sani ba."
- Ka buga tushen: Nuna labarin da amsar ta dogara akansa; Yana ba da tabbaci kuma yana sauƙaƙe tabbatarwa.
- Duba ga gibba: Tattara tambayoyi inda bot ya ce "Ban sani ba"; Waɗannan suna nuna gazawar da ke cikin tushen ilimin, ciyarwa daga can.
Samfura huɗu masu kwafi
1) Matsakaicin amsawar RAG:
AMSA TA HANYAR KAN ɓangarorin [SURCE] masu zuwa. Dokoki: (1) Yi amfani da bayanan da ke cikin tushen kawai, (2) idan ba a cikin tushen ba, sai ku ce "Ba ni da takamaiman bayani game da wannan, bari in haɗa ku da wakilin", (3) bayyana labarin da ya dogara da shi azaman [Source: abu-no], (4) faɗi adadin / tsawon lokaci / yanayin daidai daga tushen, kada ku tattara / gyara. [SOURCE]: <<abubuwan da aka jawo>>Tambaya: "<<Tambayar abokin ciniki>>"
2) Rubutun labarin tushen ilimi:
Maida rubutun manufofin tarwatsa masu zuwa zuwa labarin FAQ wanda ya dace da RAG. Tsarin: Tambaya (a cikin yaren abokin ciniki) / Amsa gajeriyar magana (jumloli 2-3) / Sharuɗɗan (shafi) / Kwanan sabuntawar ƙarshe / Tambarin taken. Yi alama ga kowane mahimmin maki a matsayin "don a fayyace", yin imani. Rubutun asali: << rubutu>>
3) Binciken sabani da gibba:
Yi nazarin abubuwan tushe na ilimi masu zuwa. (1) Alama nau'i-nau'i na labaran da suka yi karo da juna (misali lokacin dawowa daban-daban). (2) Yi hasashen batutuwan da za a yi ta yawan tambaya amma ba su da amsoshi. Dubi abubuwan da aka bayar kawai; samar da sababbin manufofi.Labarai: <<list>>
4) Ingantawa daga "Ban sani ba" log:
A ƙasa akwai tambayoyin da bot ɗin ya kasa amsawa (ba a iya samun tushe ba). Sanya su cikin batutuwa kuma a ba da shawarar taken labarin da ya kamata a ƙara zuwa tushen ilimin kowane rukuni. Kada ku haɗa amsar da ke cikin, kawai gaya mani abin da ya ɓace. Tambayoyi: <<jeri>>
Rauni mai ƙarfi / Ƙarfi mai ƙarfi
Rawanin faɗakarwa:
Amsa tambayar dawowar abokin ciniki.
Babu tushe; Samfurin na iya dacewa da ƙwaƙwalwar ajiya, adadin / tsawon lokaci na iya zama kuskure, ba za a iya tabbatarwa ba.
Ƙarfi mai ƙarfi:
Amsa kawai bisa la'akari da juzu'in manufofin dawowa da ke ƙasa. Idan babu shi a cikin majiyar, a ce "Ban sani ba tabbas". Ka faɗi lokaci da yanayin a zahiri, ba da tunani ta hanyar [Source: RETURN-03] [Source: RETURN-03]: "Za a iya dawo da samfurin da ba a yi amfani da shi ba cikin kwanaki 14. Keɓaɓɓen samfuran ba su cikin iyakokin dawowa." Tambaya: "Zan iya dawo da keɓaɓɓen samfurin da na saya kwanaki 20 da suka wuce?"
Bambance-bambance: tushen tushen, wajibi na tunani, hana ƙirƙira bayyananne; samfurin yana haifar da amsa daidai ("kwanaki 14 da suka wuce da keɓaɓɓen, ba za a iya dawowa ba") daga tushen.
uku mini lokuta
Case 1 - Ƙarshen hallucination. Amsar bot ta telecom daidai ga tambayoyin yaƙin neman zaɓe shine 71% a cikin saitin no-RAG; Samfurin wani lokaci ya haɗa tsoffin kamfen. Lokacin da aka haɗa shafukan yaƙin neman zaɓe na yanzu zuwa RAG kuma an ƙara dokar "kada ku faɗi idan ba a cikin tushen ba", daidaito ya karu zuwa 96% kuma gunaguni game da "kalmomin kamfen na kuskure" ya kusan ƙare.
Case 2 - Farashin sabani. A cikin tushen ilimin kamfani na e-commerce, an rubuta farashin jigilar kayayyaki daban-daban guda biyu akan shafuka biyu (ɗayan halin yanzu, tsohon shafin da aka manta). Bot ɗin yana jan wani ba da gangan yana gaya wa wasu abokan cinikin farashin da ba daidai ba. Lokacin da aka adana tsohon shafin tare da ƙa'idar tushe guda ɗaya daidai, rashin daidaituwa ya ɓace. Darasi: RAG ba ya warware sabani, yana yada sabani kamar yadda yake.
Harka ta 3 — Darajar littafin “Ban sani ba”. A wani banki, bot yana cewa "Ban sani ba tabbas" zuwa ~ 4,000 tambayoyi a wata. Lokacin da aka haɗa waɗannan tambayoyin, an ga cewa kashi 40 cikin 100 sun shafi "amfani da katin ƙasa"; Babu labarin game da shi. Lokacin da aka ƙara abubuwan da suka dace, an warware waɗannan tambayoyin kuma yawan kuɗin da aka samu ga mutane akan wannan batu ya ragu da kashi 55%. Gaskiyar cewa bot ɗin ya ce bai sani ba ya zama taswirar hanya don ingantawa.
Kuskuren gama gari
- Amsa ba tare da haɗi zuwa tushen ba. Ba tare da RAG ba, samfurin ya dace da cikakkun bayanai; Duk wani tabbataccen amsa dole ne ya dogara da tushen.
- Kashe zaɓin "Ban sani ba". Tilasta samfurin don amsa kowace tambaya yana tabbatar da dacewa.
- Ba share bayanai masu karo da juna ba. RAG yana yada sabani; Madogara madaidaiciya guda ɗaya yana da mahimmanci.
- Yin sakaci ga shred. Fitar da manyan PDFs kamar yadda yake yana hana samun dama ga daidai; Yi amfani da gajerun labarai, jigo guda ɗaya.
- Boye tushen. Rashin nuna abin da aka dogara da amsar yana raunana tabbaci da amana.
Tsanaki: RAG yana inganta daidaito amma baya bada garantin 100%. Samfurin na iya yin kuskure a wasu lokutan da aka kama. Don haka batutuwan kudi, shari’a da tsaro suna bukatar amincewar dan’adam ko da an kawo majiyar; RAG yana rage hallucination amma baya cire alhakin.
a takaice
Tushen ilimi da RAG sune tushen daidaiton cibiyar kira AI. RAG ya fi hana hallucination ta hana samfurin dacewa da amsa daga ƙwaƙwalwar ajiya da dogaro kawai ga tushen yanzu. Amma RAG yana da kyau kamar tushen iliminsa: tushen ilimin da ya dace da zamani, bayyananne, tsari, rashin rikici kuma yana da tushe guda na gaskiya yana da mahimmanci. Faɗa samfurin "idan ba a cikin tushen ba, gaya mani ba ku sani ba", nuna tushen, kuma yi amfani da tambayoyin da bot ba zai iya amsawa ba don inganta tushen iliminsa. Kula da yardar ɗan adam duk da tushen abubuwan da ke da babban tasiri.
Aikin aikace-aikace
Rubuta tambayoyin abokin ciniki na gaske / na gaske 8 daga masana'antar ku da 8 daidai gajerun labaran tushe na ilimi (kowane labarin: tambaya, gajeriyar amsa, yanayi, kwanan wata, alama). Sannan gwada ko samfurin zai iya cewa "Ban sani ba" ta hanyar amfani da tsarin "1) Tight RAG answer prompt" da kuma yin tambaya, ɗaya daga cikinsu ba ya cikin tushen ilimi. A ƙarshe, bincika labaranku tare da "3) Saɓani da duban rata".
jerin abubuwan dubawa
- [ ] Kowace amsa da bot/mataimaki ya bayar ya dogara da tushen ilimin yanzu (ta hanyar RAG).
- [ ] Na umurci samfurin "idan ba a cikin tushen ba, gaya mani ba ku sani ba" kuma na gwada shi.
- [ ] Tushen ilimina ya ƙunshi labarai na zamani, bayyane, labarai guda ɗaya.
- [ ] Na share abubuwan da suka saba da juna da tsofaffi; Akwai madaidaicin tushe guda ɗaya don duk bayanai.
- [ ] Amsoshi suna nuna wace labarin ya dogara ne akan (source).
- [ ] Ina tattara tambayoyin "Ban sani ba" kuma na ciyar da tushen ilimi.