Haɓaka Kuɗi: Canje-canje na gaggawa

Riba:

• Bayyana madaidaicin madaidaicin dabaru na caching da sauri
• Yana ƙara cache buga ta hanyar sanya kafaffen mahallin farko da mahallin mai canzawa bayan
• Iya lissafta cache rubuta/ karanta tattalin arziki da karya-ko da maki

Samfurin LLM yayi kama da arha a samfur; Lokacin da kuka haura zuwa ma'auni, lissafin yana mamaki. A mafi yawan nauyin aiki, yawancin lissafin sun fito ne daga ƙayyadadden mahallin da aka aika akai-akai tare da kowane buƙatu: dogon tsarin faɗakarwa, littafin ƙa'ida, takaddun bayanai. Yin caching na gaggawa yana kawar da wannan sharar. A cikin wannan rukunin, zaku koyi yadda cache ɗin ke aiki, yadda ake tsara saurin bugu, da yadda ake ƙididdige madaidaicin madaidaicin tattalin arzikin cache. Lokacin shigar da shi daidai, shi kaɗai zai iya yanke lissafin ku rabin ko ma ƙasa.

Yaya Cache ke Aiki? Doka Mai Sauƙi Daya

Caching da sauri wasa ne na prefix. Mai badawa yana adana alamun da ya sarrafa na ɗan lokaci tun farkon faɗakarwar ku. Idan faɗakarwa ta fara da prefix iri ɗaya akan buƙatun na gaba, wannan ɓangaren gama gari ba a sake ƙididdige shi ba; Yana da arha don karantawa fiye da cache.

Doka ɗaya mara canzawa tana zuwa daga wannan: Idan byte ɗaya ya canza ko'ina a cikin prefix, gabaɗayan cache ɗin ya zama mara aiki daga wannan lokacin gaba. Wato, ƙayyadaddun abun ciki yakamata ya kasance a farkon kuma abun ciki mai canzawa yakamata ya kasance a ƙarshe. Idan ka sanya layi a farkon tsarin da ke haifar da canzawa tare da kowace buƙata, kamar "Ranar Yau: 18.07.2026", duk abin da ke bayansa ba zai iya shigar da cache ba.

Tsarin sarrafawa yawanci shine: kayan aiki → gaggawar tsarin → saƙonni. Kun sanya wurin cache (breakpoint) a ƙarshen ƙayyadaddun sashe.

Cache Tattalin Arziki

Cache yana da matakan farashi guda uku:

• Rubutun cache: Ajiye a karon farko. ~ 1.25x farashin shigarwa na yau da kullun (don ajiyar minti 5).
• Karanta cache: Karatu akan buƙatun na gaba. ~0.1 sau na al'ada farashin shigarwa - wato, daya bisa goma.
• Shigarwa ta al'ada: Bangaren da baya shigar da cache kuma ana sarrafa shi akan cikakken farashi kowane lokaci.

Hutu-ko da ma'ana: Buƙatar farko tana biyan ƙimar ƙima (1.25×). Daga buƙatun na biyu, karatun (0.1×) ya zo cikin wasa. Kusan, za ku zama wuya da wuya a kan buƙatun biyu; Bayan haka, shi ne net tanadi. Mafi girman ƙayyadaddun mahallin da kuma ƙarin buƙatun da ake sake amfani da shi, mafi girman riba ya zama.

Halin yanayi

Shin cache yana aiki?

Babban tsayayyen tsarin gaggawa, dubban buƙatun

Ee - mafi girman albashi

Tambayoyi da yawa akan takaddun tunani iri ɗaya

Ee

Gajerun rubutu daban-daban ga kowane buƙatu

A'a - rubuta kari ya ɓace

Buƙatar lokaci ɗaya

A'a - babu karatu kwata-kwata

Kwanan wata/ID yana canzawa tare da kowane buƙatu a saurin tsarin

A'a - prefix ya karye, buga ba shi da sifili

Mataki-mataki: Yadda za a Saita Ƙaƙwalwar Bugawa?

1. Rarrabe akai-akai da mai canzawa. Wane abun ciki ne bai taɓa canzawa ba (sauƙarwar tsarin, littafin doka, takaddun shaida)? Wanne ya canza tare da kowace buƙata (tambayar mai amfani, kwanan wata, ID)?
2. Saka akai akai a farkon. A lokacin aiki, ɓangaren da ya zo na farko (kayan aiki, tsarin) dole ne ya kasance barga.
3. Saka m a karshen. Tambayar mai amfani ta yanzu, ta ƙarshe.
4. Sanya alamar a ƙarshen iyakar. Saka wurin cache a cikin toshe na ƙarshe na ƙayyadaddun ɓangaren.
5. Tabbatar da bugawa. Bincika idan cache_read_input_tokens ya fi sifili a filin amfani a cikin martani. Idan sifili, akwai ɓoyayyiyar ɓarna a cikin prefix.

{"tsarin": [ {"nau'in": "rubutu", "rubutu": "{{large_constant_system_promptu_and_rules}}", "cache_control": {"nau'in": "ephemeral" }}], "saƙonni": [ {"role": "mai amfani", "abun ciki": "{_} mai amfani ]} }ren"

Tukwici: Kar a yi tsammanin buguwar cache, auna su. Idan usage.cache_read_input_tokens har yanzu ba shi da komai akan buƙatun jere, mai karya shiru (datetime.now() a tsarin gaggawar, JSON da ba a ba da oda ba, jerin kayan aikin da ke canzawa tare da kowace buƙata) yana gudana. Kwatanta ɗanyen faɗakarwa na buƙatun biyu byte byte kuma nemo bambanci.

Masu Rushewar shiru

Misali na yau da kullun waɗanda ke lalata cache cikin rashin sani:

# BREAKER: shigar da bayanai a cikin tsarin da ke haifar da canje-canje tare da kowane buƙatun "Ranar Yau: {{yanzu}}. Kai mataimaki ne..." ← prefix canje-canje tare da kowane buƙatu, buga shi ne sifili# GASKIYA: matsar da m zuwa tsarin saƙo: "You are a mataimakin..." a karshen

Sauran masu karyawa: JSON an jera su daban-daban akan kowane buƙatun (a kiyaye maɓallai a tsayayyen tsari), jerin kayan aikin da suka bambanta ta mai amfani (ana fara sarrafa kayan aikin; babu abin da ke shiga cikin cache idan sun canza), canza ƙirar tsakiyar tattaunawa (caches sune takamaiman ƙirar ƙira).

Rauni mai ƙarfi / ƙarfi mai ƙarfi (tsarin abokantaka na cache)

# WEAK (cache busting gini) tsarin: "Kwanan: 18.07.2026 14:32. Mai amfani: Ahmet (id 8842). Kai ne mai goyon bayan bot. Dokokin: ... (2000 tokens)..."

# KARFI (tsarin abokantaka na cache) tsarin: "Kuna goyon bayan bot. Dokokin: ... (alamu na 2000, ba za su canza ba)..." [alamar cache] saƙonni: [ {rawar: mai amfani, abun ciki: "Kwanan: 18.07.2026 14: 32. ID mai amfani: 8842. Tambaya: ta yaya zan fara biya?" }]

A cikin sigar rauni, ana aiwatar da toshe ƙa'idar token 2000 akan cikakken farashi akan kowace buƙata. A cikin ƙaƙƙarfan juzu'i, an rubuta toshe iri ɗaya sau ɗaya kuma a karanta akan duk buƙatun na gaba don kashi goma na farashi.

Mini Cases guda uku

Case 1 - Caching littafin doka. Ƙididdigar lissafi tana ƙara littafin ƙa'idar alamar 12,000 zuwa kowane daftari; buƙatun 5,000 kowace rana. Kudin shigar da cacheless ~ $180 kowace rana. Sun kiyaye littafin ƙa'idar akai-akai kuma sun adana shi: buƙatun farko sun biya ƙimar rubutu, karantawa na gaba 0.1 ×. Farashin shigarwa ya ragu ~90% zuwa ~$18 kowace rana.

Case 2 - Kudin layin kwanan wata da aka ɓoye. Ƙungiya ɗaya ta kafa cache amma ba ta samu nasara ba; cache_read_input_tokens koyaushe ya kasance sifili. Dalili: Akwai datetime.now() a cikin layin farko na tsarin faɗakarwa, prefix yana canzawa tare da kowace buƙata. Lokacin da muka matsar da kwanan wata zuwa saƙon mai amfani, ƙimar bugawa ba zato ba tsammani ya ƙaru daga 0% zuwa 94%.

Case na 3 - Kuskuren cache. Wani aikace-aikacen nema yana aika gajerun tambayoyi daban-daban tare da kowace buƙata; Suna ɗokin ƙara alamar cache. Ba tare da prefix na gama-gari ba, kowane buƙatun ya biya ƙimar rubutu kawai, babu karantawa - yana ƙaruwa farashin. Suka cire alamar. Darasi: cache yana biya ne kawai idan akwai babba kuma akai-akai wanda aka sake amfani dashi.

Kuskuren gama gari

• Cakuda akai-akai da m: Lokacin da m abun ciki ke a cikin prefix, buga za a sake saita.
• Haɗa kwanan wata/ID a cikin hanzarin tsarin: Mafi yawan ɓarna shiru.
• Ba a auna bugun ba: Idan cache_read_input_tokens ba a duba ba, ba za a lura da sharar gida ba.
• Ƙara cache lokacin da babu prefix na jama'a: Kuna biyan kuɗin rubutu kawai, farashin yana ƙaruwa.
• Canza lissafin abin hawa ko samfurin: An karye prefix tun daga farko; an sake rubuta komai.
• Mantawa mafi ƙarancin girman cache: gajeriyar cache (a ƙarƙashin ~ 1-4k token dangane da ƙirar) ba zai shigar da cache shiru ba.

Zurfafa: Zane Cache ta Nau'in Kayan Aiki

Ainihin biyan kuɗin caching ya bambanta dangane da yanayin aikin ku; don haka fara sanin zirga-zirgar ku. Hanyoyi guda uku na al'ada da ingantaccen shigarwa:

Tsarin gama-gari yana faɗakarwa, tambayoyi daban-daban. Mafi yawan tsarin kasuwancin gama gari: babban tsarin faɗakarwa (rawar aiki, ƙa'idodi, ƙila daftarin aiki) tare da ɗaruruwan tambayoyin mai amfani daban-daban. Anan kayyadadden ɓangaren (tsarin) yana ɓoye da farko; kowace sabuwar tambaya tana biyan cikakken farashi kawai don ƙaramin rabonta. Ribar tana da girma sosai saboda ana karanta babban rabo akai-akai akan kashi goma na farashin.

monologue mai zagaye da yawa. Yayin da zance ke jan hankali, kowane sabon zagaye yana ginu akan duk tarihin baya. Idan kun sanya tutar cache a ƙarshen zagaye na ƙarshe, kowace buƙata ta sake yin amfani da prefix ɗin tattaunawar da ta gabata; hits suna taruwa yayin da zancen ke girma. Wannan yana da matuƙar ƙarfi a cikin farashin dogon zaman mataimakin.

Gaban da aka raba shi ne ɗan ƙarshe don canzawa. Buƙatun da yawa suna raba babban saitin ƙayyadaddun abubuwan da aka gyara (samfurin saitin, umarni) amma an raba su da tambaya ɗaya a ƙarshen. Kun sanya alamar cache a ƙarshen ɓangaren da aka raba; In ba haka ba, kowace bukata za ta rubuta nata cache daban kuma ba za a karanta ko ɗaya ba.

Ɗaya daga cikin caveat: cache ɗin ya dogara da samfurin da ƙayyadaddun ƙananan girman. Ƙananan prefixes (ƙarƙashin ƴan alamu dubu kaɗan, dangane da ƙirar) ba za su shiga cikin cache cikin shiru ba ko da kun tuta su - cache_creation_input_tokens ya rage sifili. Hakanan, canza ƙirar tsakiyar tattaunawa yana lalata duk cache; Idan wani aiki na daban yana buƙatar samfurin arha, kiyaye babban kwarara a cikin ƙirar ɗaya kuma sanya aikin gefe a cikin kira daban.

A takaice

Caching da sauri wasa ne na prefix: ƙayyadadden abun ciki yakamata ya kasance a farkon, abun ciki mai canzawa yakamata ya kasance a ƙarshe. Don babban mahallin da aka sake amfani da shi, farashin karantawa shine kashi goma na cikakken farashi, kusan karya ko da a cikin buƙatun biyu. Kuskuren da aka fi sani shine lalata prefix ta hanyar shigar da bayanai masu canzawa a cikin saurin tsarin; Kuna tabbatar da bugun ta auna shi a cikin filin amfani.

Aikin aikace-aikace

Zaɓi nauyin aiki. (1) Raba abun ciki zuwa ginshiƙai biyu: "ba za su taɓa canzawa" da "canzawa tare da kowace buƙata ba". (2) Sake tsarin da sauri, sanya sashin dindindin a farkon kuma sashin mai canzawa a ƙarshen. (3) Ƙididdiga girman alamar ƙayyadaddun ɓangaren kuma kwatanta farashin kowane wata tare da / ba tare da cache ba. (4) Lura da wane filin (cache_read_input_tokens) zaku tabbatar da bugun daga.

jerin abubuwan dubawa

• [ ] Zan iya bayyana cewa cache daidai yake da prefix kuma kawai ƙa'idar da ba za ta iya canzawa ba.
• [ ] Zan iya ƙara daidaito ta hanyar sanya ƙayyadaddun abun ciki a farkon kuma mai canzawa a ƙarshen.
• [ ] Na san rubuta / karanta tattalin arziki da kuma buƙatun buƙatun biyu-ko da.
• [ ] Zan iya gane masu ɓarna shiru (kwanan wata, JSON da ba a ba da oda ba, canza lissafin abin hawa).
• [ ] Zan iya tabbatar da bugun tare da amfani.cache_read_input_tokens.