On-Prem, VPC da Openweight Hosting

Riba:

• Ikon kimanta cinikin ciniki tsakanin API ɗin sarrafawa, VPC da kuma kan-prem hosting
• Ability don yanke shawara akan hosting dangane da ikon mallakar bayanai, girma da ƙarfin aiki
• Ikon ƙididdige jimlar kuɗin mallakar (TCO) tare da cikakkun abubuwa da ƙira ƙirar gine-gine

Ga wasu ƙungiyoyi, "aika bayanai zuwa ga mai bayarwa" - ko ta yaya amintaccen - ba a karɓa ba. A cikin masana'antar tsaro, jama'a, banki da wasu yanayin kiwon lafiya, bai kamata bayanai su wuce iyakar cibiyar ba. A wannan gaba, ɗaukar nauyin samfurin ku ya zo kan gaba: ƙirar ƙira mai buɗewa, yana gudana a cikin hanyar sadarwar girgije ku (VPC) ko akan sabobin ku (on-prem). A cikin wannan rukunin za mu koyi ciniki tsakanin API ɗin sarrafawa da ɗaukar nauyin kai, lokacin da yake da ma'ana, da jimlar kuɗin mallakar (TCO).

ra'ayoyi

• API ɗin Gudanarwa: Yana gudana akan kayan aikin mai samarwa; Kuna aika buƙatu kuma ku sami amsa. Ƙarfin aikin yana da ƙanƙanta, amma bayanan yana zuwa ga mai bayarwa.
• Bude-nauyi samfurin: Za a iya sauke sigogi na ƙira (masu nauyi); Kuna iya sarrafa shi akan kayan aikin ku. Ba lallai ba ne iri ɗaya da "buɗewar tushen" (lasisi na iya bambanta).
• VPC hosting (Virtual Private Cloud): Gudanar da samfurin a cikin keɓaɓɓen cibiyar sadarwar ku; Bayanan sun kasance a kan iyakar hanyar sadarwar ku, amma har yanzu abubuwan more rayuwa suna cikin gajimare.
• On-prem (a kan-gida): Gudanar da samfurin gaba ɗaya akan kayan masarufi a cibiyar bayanan ku; iko mafi girma, mafi girman nauyin aiki.

Tsanaki: "Mai kula da kansa koyaushe yana da aminci" kuskure ne. Tsaro ya dogara kaɗan akan inda kuke adana bayanai da ƙari akan yadda kuke sarrafa su. Sabar sabar da ba ta fashe ba, mara kyau da aka saita akan uwar garken tana da haɗari fiye da babban API ɗin da aka sarrafa.

Axis yanke shawara: Yaushe?

Tambayoyi uku suna jagorantar shawarar:

1. Mallakar bayanai: Shin doka ko kwangila sun hana bayanai barin cibiyar/kasa? Idan eh, za a tura ku zuwa VPC/on-prem.
2. Girma da farashi: Shin amfani yana da girma kuma ana iya faɗi? Maɗaukaki masu yawa na ɗaukar nauyin kai na iya rage farashin naúrar; API ɗin da ake sarrafa shi a ƙananan ƙararraki/kuskuren kusan koyaushe yana da arha.
3. Ƙarfin aiki: Shin kuna da ƙungiyar don kula da ababen more rayuwa na GPU, haɓaka samfuri, sikeli, da facin tsaro? In ba haka ba naku hosting naku kuɗi ne na ɓoye.

Teburin Ciniki

Girman

API ɗin sarrafawa

Farashin VPC

On-Prem (bude nauyi)

Mulkin bayanai

Amince mai bayarwa

Babban (a iyakar hanyar sadarwar ku)

Mafi girma (ba ya tashi)

Load ɗin aiki

ya yi ƙasa da ƙasa

matsakaici

babba

Farashin farko

Ƙananan (biya yayin da kuke tafiya)

matsakaici

High (hardware)

gwargwado

atomatik

Gudanarwa

alhakinku

Model ingancin / kudin

sabon abu, atomatik

Ya dogara

Ka sabunta

sarrafawa

ƙananan

babba

cika

Mataki-mataki: Matakin Hosting

1. Ƙayyade ajin bayanai. A wane matakin sirri ne za a sarrafa bayanai?
2. Tabbatar da haƙƙin doka. Za a iya fitar da bayanai? (KVKK, tsarin yanki, kwangila.)
3. Ƙimar ƙarar. Buƙatun wata-wata/ƙarar alama da lanƙwan girma.
4. Yi lissafin TCO. Ba kawai GPU ba; makamashi, kiyayewa, tawagar, tsaro, redundancy.
5. Yi tunanin matasan. Samfurin matasan da ke sarrafa bayanai masu mahimmanci a cikin on-prem/VPC da bayanan marasa hankali a cikin API da aka sarrafa galibi shine mafi kwanciyar hankali.

Samfura guda huɗu masu Kwafi

Saurin yanke shawara:

Yanke shawarar hosting don amfani mai zuwa: {{scenario }}Tambayoyi: - Menene ajin keɓewar bayanan da za'a sarrafa? (sirri na jama'a / na ciki / sirri / babban sirri) - Shin doka / kwangilar ta ba da damar bayanai don fita waje da kungiyar? - Hasashen girma na wata-wata da tsinkaya? - Shin akwai aiki / ƙarfin ƙungiyar GPU? Shawarwari: "Gudanar da API / VPC / On-prem / Hybrid" + barata.

Jerin abubuwan TCO (don ɗaukar nauyin kai):

Ƙididdige jimlar kuɗin mallakar ta:- Hardware (GPU) sayan/ haya- Makamashi da sanyaya- Mutum: MLOps + lokacin ƙungiyar tsaro- Sabunta samfuri da gwajin ƙarfin aiki- Ragewa/murmurewa bala'i- Faci da sa ido Kwatanta wannan da lissafin kowane wata don API ɗin da aka sarrafa sama da sararin sama na wata 12-24.

Ka'idojin hanyar zirga-zirgar mahalli:

Hanyar kowane buƙatu dangane da ajin bayanai: - "asiri / babban sirri" bayanai -> tsarin kan-prem/VPC- "bayanin jama'a / na ciki" -> API ɗin sarrafawa (mafi ƙarfi/mai rahusa)Rubuta yanke shawarar turawa da ajin bayanai zuwa rajistan binciken.

Bude saurin duba lafiyar nauyi:

Yi la'akari da ƙirar mu mai ɗaukar nauyinmu:- Shin lasisi yana ba da damar kasuwanci da amfani kuma a cikin yanayinmu? - Ma'aunin ƙira daga tushen amintaccen, mutunci (hash) an tabbatar da shi? - An shigar da facin uwar garke, keɓewar hanyar sadarwa, an shigar da ikon shiga? - Ana sa ido da shiga cikin girma kamar API ɗin da aka sarrafa? Alama duk wani abu da ya ɓace a matsayin "ON".

Rauni Mai Sauƙi / Ƙarfi Mai ƙarfi

rashin tsari

Hanya mai ƙarfi

"On-prem ya fi aminci, koyaushe amfani da shi"

Hukunci dangane da ikon mallakar bayanai + girma + iya aiki

Kawai kallon farashin GPU

Cikakken TCO (makamashi, ma'aikatan jirgin, sabuntawa, tsaro)

Kasancewa a kulle cikin samfuri guda ɗaya

Hybrid: hanya ta hanyar ajin bayanai

Gudu ba tare da rage nauyin budewa da tabbatar da shi ba

Lasisi + mutunci + faci + sarrafa alama

Mini Cases guda uku

Shari'a 1 - Wa'adin kan-prem shine shawarar da ta dace. Wani dan kwangilar tsaro shine ya aiwatar da takaddun keɓaɓɓu; Kwangilar ta hana fitar da bayanai daga kasar. API ɗin da aka sarrafa an kawar da shi daga farko. An kafa samfurin buɗaɗɗen nauyi na kan-prem; Kudin yana da yawa, amma shine kawai zaɓin da ya dace.

Shari'a 2 - TCO na sirri ya sake yanke shawara. Farawa ya shirya don canzawa zuwa karɓar kai saboda "API yana da tsada." A cikin lissafin TCO, kun haɗa ba kawai GPU ba; Ƙara injiniyoyin MLOps na cikakken lokaci 2, ɗaukakawa, da sakewa, kuma jimlar watanni 24 ya ninka na API ɗin sarrafawa. Sun kasance a cikin API saboda kundin su ya yi ƙasa da ɗan lokaci.

Case 3 - Hybrid ya ba da mafi kyau. Mataimakin cibiyar kiran banki yana sarrafa nau'ikan bayanai iri biyu: tambayoyin samfur na gabaɗaya da takamaiman bayanan asusun abokin ciniki. Ana yin bayanin bayanan asusu zuwa samfurin da ke cikin VPC, tambayoyin gaba ɗaya ana jagorantar su zuwa API mai ƙarfi da aka sarrafa. Bayanai masu mahimmanci ba su taɓa fita ba, an yi amfani da ingancin samfurin mafi ƙarfi don tambayoyi na gaba ɗaya; farashi da dacewa an inganta su tare.

Tukwici: Ba dole ba ne yanke shawara ya zama binary (duk ko ba komai). Haɓaka gine-gine-hanyoyin sarrafa bayanai ta aji-lokaci guda suna warware yarda da farashi a yawancin yanayin kasuwanci.

Kuskuren gama gari

• A ɗauka "nasu hosting yana da aminci ta atomatik"; alhali tsaro ya dogara da ingancin gudanarwa.
• Tunanin cewa TCO shine kawai farashin GPU; ƙungiya, makamashi, sabuntawa da mantawa game da tsaro.
• Canzawa zuwa ɗaukar nauyin kai a ƙaramar ƙaramar / mara daidaituwa da haɓaka farashin naúrar.
• Amfani da buɗaɗɗen samfurin nauyi ba tare da tabbatar da lasisi da mutunci ba (hash).
• Rashin shigar da saka idanu/ shiga kamar balagagge kamar API ɗin sarrafawa akan sabar kan-prem.
• Yin yanke shawara na binary ba tare da la'akari da zaɓin matasan kwata-kwata ba.

a takaice

• API ɗin sarrafawa shine mafi sauƙin aiki, amma bayanan yana zuwa ga mai bayarwa; VPC/on-prem yana adana bayanai a kan iyakar ku.
• Tambayoyi guda uku ne ke jagorantar yanke shawara: ikon mallakar bayanai, tsinkayar girma/farashi, da ƙarfin aiki.
• "Yin kai ya fi aminci" kuskure ne; Tsaro ba ya dogara da inda kuke adana bayanai ba, amma akan yadda kuke sarrafa su.
• Yi ƙididdige ainihin TCO: makamashi, ƙungiya, sabuntawa, sakewa da tsaro, gami da GPU.
• Haɓaka gine-gine (bayanan tuƙi ta aji) a lokaci guda suna daidaita daidaito da farashi a yawancin yanayin kasuwancin.

Aikin aikace-aikace

Zaɓi amfani da AI kuma raba bayanan da za a sarrafa zuwa aji na keɓantacce. Ƙirƙirar shawarwari tare da saurin yanke shawara. Sannan cika jerin abubuwan TCO don ɗaukar nauyin ku kuma kwatanta jimlar watanni 24 zuwa lissafin API ɗin da aka sarrafa. A ƙarshe, rubuta daftarin ƙa'idar jigilar kayayyaki: menene bayanai ke zuwa ina?

jerin abubuwan dubawa

• [ ] Na ƙulla ajin sirri da ƙuntatawa na doka na bayanan da za a sarrafa.
• [ ] Na yanke shawarar karbar bakuncin bisa ga ikon mallaka + girma + iyawa.
• [ ] Na ƙididdige TCO tare da cikakkun abubuwa (ciki har da waɗanda ba GPU ba).
• [ ] Na duba lasisi, mutunci, faci da saka idanu akan ɗaukar nauyin kai.
• [ ] Na yi la'akari da zaɓin hanyar tuƙi na matasan.
• [ ] Na rubuta hukuncin da dalilinsa.