Riba:
- Ƙarfin gane fuskoki uku na amintaccen amana (marasa tabbaci, tabbatar da kai, ƙwaƙƙwaran ƙima) da kuma amfani da maganin rigakafi.
- Ikon yin amfani da gwajin maye gurbi da maki maye gurbi a matsayin ma'aunin inganci mafi inganci fiye da kashi dari ta kayan aiki ko hannu
- Ikon sanya AI a matsayin ƙungiyar ja a kan gwaji da farauta don gwajin madauki ba tare da faɗuwa cikin tarkon yabo ba
A cikin zuciyar wannan ƙirar akwai faɗakarwa mai maimaitawa: koren gwajin haske mai haske ba shaida na inganci ba. Idan gwaje-gwajen ku sun ba ku kwarin gwiwa, kuna buƙatar sanin ko wannan amincewar gaskiya ce ko ta karya. A cikin shekarun basirar wucin gadi (AI), wannan tambayar tana da mahimmanci fiye da kowane lokaci, saboda AI ta kware wajen samar da ruwa, mai santsi amma gwaje-gwaje mara kyau. Amincewa na ƙarya - gaskata software daidai ne saboda gwaje-gwajen kore ne, yayin da a zahiri gwaje-gwajen ba su tabbatar da komai ba - shine abu mafi haɗari da zai iya faruwa ga ƙungiyar QA; domin ba ya boye cewa babu kurakurai, amma ba za ka iya ganin kurakurai ba. Wannan rukunin yana haɗa ingantaccen falsafar gabaɗayan tsarin cikin horo ɗaya: gwada gwaje-gwajenku.
Matsayin gwal don auna ingancin gwaji: gwajin maye gurbi
Hanya mafi ƙarfi don fahimtar ko a zahiri gwajin yana kare ko a'a shine gwajin maye gurbi (gwajin maye gurbi - dabarar da ke haifar da ƙananan murdiya/maye gurbi a cikin lambar tushe da auna ko gwaje-gwajen sun gano waɗannan murdiya). Hankali mai sauƙi ne: idan da gangan kuka karya lambar (yin + cikin -, a> cikin> =, gaskiya zuwa ƙarya), babban ɗakin gwaji ya kamata ya kama wannan ɓarna kuma ya juya ja. Idan ba haka ba, wannan rugujewar mutant ce da ta tsira - don haka gwaje-gwajen ku ba a zahiri suna kiyaye wannan halayyar ba.
Sakamakon maye = maye gurbi ya mutu / jimlar maye gurbi. Kunshin da ke da ɗaukar nauyin layi na 90% na iya samun ƙimar maye gurbi na 40%; Wannan yana nuna cewa layin suna aiki amma ba a tabbatar da halayen ba. Makin maye gurbin shine ma'aunin inganci mafi gaskiya fiye da ɗaukar nauyin kashi.
Tukwici: Akwai kayan aikin maye gurbi ta atomatik (PIT/Pitest don Java, Stryker don JavaScript/TypeScript, Stryker.NET don NET, mutmut don Python). Waɗannan suna samarwa ta atomatik kuma suna gwada ɗaruruwan maye gurbi. Idan ba ku da kayan aiki, har ma da jagorar "karye gwajin lambar" hanya ce mai mahimmanci ga ayyuka masu mahimmanci.
Fuskoki guda uku na yaudarar amana da maganinta
Siffar amana
alama
maganin rigakafi
Gwaji ba tare da tabbatarwa ba
Code yana aiki, babu abin da aka inganta
Tabbatar da gaskiya a kowane gwaji; gwaji tare da maye gurbi
jarrabawar tabbatar da kai
Ana tsammanin = fitarwa na lamba
Yi ƙididdige ƙimar da ake tsammani da kansa
Tabbatarwa maras muhimmanci
"ba komai ba", "200 sun dawo"
Tabbatar da dokar kasuwanci/sakamako na gaskiya
Babban fa'ida
90% Lines, ƙananan kariya
Dubi maki maye gurbi
Haƙurin gwaji mara ƙarfi
"Make kuma, wuce"
Tushen sanadin + gwajin ƙaddara
Amfani da AI a matsayin "ƙungiyar ja"
AI na iya haifar da amintaccen amana kuma ya kasance ƙaƙƙarfan ƙawance wajen farautar ta. Yi amfani da AI azaman ƙungiyar ja akan gwaje-gwajen ku: tambayi "Rubuta lambar da ta wuce waɗannan gwaje-gwajen amma ba daidai ba" ko "nemo ɓarna da za ta yaudare waɗannan gwaje-gwajen." Idan AI ta sami madauki a cikin gwaje-gwajen ku, waɗancan madogaran haɗari ne na gaske.
Tsanaki: Kada ku tambayi AI "Shin ingancin gwajin na yana da kyau?" kuma ɗauki amsar "e, babba" a matsayin tabbaci. AI yana son zama mai kirki. Madadin haka, kalubalanci AI zuwa ingantaccen aiki: "samar da kwaro wanda ya wuce waɗannan gwaje-gwaje." Idan zai iya samar da shi, gwaje-gwajenku sun makance da wannan kuskuren.
Daidaitaccen maye gurbi da iyakan makin
Gwajin maye gurbi yana da ƙarfi, amma yana da kama: wasu maye gurbi ba sa canza halayen lambar kwata-kwata. Ana kiran waɗannan maye gurbi daidai gwargwado (madaidaicin mutant - gurbatacciyar lamba, maye gurbi wanda ke haifar da sakamako daidai da na asali). Misali, canza ƙimar farko na mabambantan da ba a taɓa amfani da shi ba baya shafar abin fitarwa; Babu gwajin da zai iya kuma bai kamata ya kama wannan ba. Saboda haka, maki 100% maye gurbi sau da yawa ba a iya cimma shi a aikace kuma ba shine burin ba. Cire daidaitattun maye gurbi da hannu yana da tsananin aiki; Don haka kar a karanta makin maye gurbi a matsayin cikakken makin jarrabawa, amma a matsayin mai nuna gaskiya na "shin da gaske gwaje-gwaje na ke kare?"
Hanyar da ta dace ita ce: maimakon a ci gaba da gudanar da gwajin maye gurbi a duk faɗin tushen lambar, gudanar da shi akan samfuran da ke ɗauke da haɗari mafi girma da ƙa'idodin kasuwanci masu rikitarwa. Bincika maye gurbi masu rai a cikin waɗannan samfuran ɗaya bayan ɗaya; Idan gibi ne na gaske, ƙara gwaji; idan madaidaicin maye ne, yi masa alama da barata kuma ku wuce. AI na iya yin gwajin farko wajen tantance ko maye gurbin da ke tsira ya yi daidai; amma yanke shawara ta ƙarshe shine ku waɗanda kuka san abin da lambar ke yi.
Tsanaki: Gwajin maye gurbi yana da tsadar lissafi (duk gwaje-gwajen da suka dace ana sake yin su don kowane maye gurbi). Don haka dabarar gama-gari kuma mai ma'ana ita ce tsara shi azaman mako-mako ko riga-kafi mai zurfi don bincike mai mahimmanci, maimakon kowane haɗuwa.
Rauni mai ƙarfi / Ƙarfi mai ƙarfi
Rauni: "Shin gwaje-gwaje na sun wadatar?"
Ƙarfafa: "Yi aiki a matsayin ƙungiyar ja don wannan aikin da gwajin gwaji. (1) Ƙirƙirar maye gurbi na 8 a cikin lambar da za a iya kashe (maye gurbin mai aiki, canjin iyaka, yanayin yanayi, mayar da canjin darajar). duk waɗannan gwaje-gwajen amma sun saba wa ka'idar Lad+ gwaje-gwaje: [manna]"
Ƙarfi mai ƙarfi; Yana sanya AI a matsayin mai jarrabawar gwaji, ba injin yabo ba.
Samfura huɗu masu kwafi
1) Ikon maye gurbi na hannu:
Ƙirƙirar mahimman maye gurbi guda 8 (ƙananan rushewar ganganci) don wannan lambar: maye gurbin ma'aikacin lissafi, iyakar kwatanta (> vs>=), juzu'i na ma'ana, dawowa/musanyawa na yau da kullun, tsallake yanayi. Ga kowane maye gurbi, kintace wanne daga cikin gwaje-gwajen da ake da su zai kama ko a'a. Lambobin gwaji: [manna]
2) Kashe maye gurbi mai rai:
Rahoton gwajin maye gurbi mai zuwa ya ƙunshi maye gurbi masu rai (ba a kama su): [jeri/ rahoto]. Ga kowane, rubuta ɗan ƙaramin gwajin da zai kashe wannan maye gurbin (lambar za ta zama ja idan aka karye ta wannan hanyar). Yi sharhi kan wane hali gwajin ya tabbatar.
3) Red tawagar - jini gwajin:
Shin za ku iya rubuta lambar da ta WUCE duk waɗannan gwaje-gwaje masu zuwa, amma ta keta dokar kasuwanci mai zuwa: [Dokar kasuwanci]. Idan haka ne, menene madogara a cikin waɗannan gwaje-gwajen da ke ba da damar hakan? Ƙara gwajin da zai rufe wannan madauki. Gwaje-gwaje: [manna]
4) Gwajin ingancin dubawa:
Duba wannan rukunin gwaji don inganci. Tick ga kowane gwaji: - Shin akwai tabbataccen tabbaci ko yana da haɓaka? - Shin ƙimar da ake tsammani mai zaman kanta ce, ta samo asali daga lambar? - Shin yana tabbatar da ka'idar kasuwanci ko wani abu maras muhimmanci? A ƙarshe bayar da kimanta "maki na gaskiya" da gwaje-gwaje 3 mafi rauni. Gwaje-gwaje: [manna]
uku mini lokuta
Hali na 1 - Rufe 92%, maye gurbin kashi 38%. Ƙungiya ɗaya ta dogara da babban ɗaukar hoto. Lokacin da aka gudanar da gwajin maye gurbi tare da Stryker, maki ya kasance 38%: yawancin maye gurbi da aka samar sun tsira. Wannan tabbaci ne cewa gwaje-gwajen ba sa tafiyar da layi da kuma tabbatar da halayen. Tawagar ta kashe makonni uku a cikin ingancin gwaji; Makin maye gurbin ya ƙaru zuwa 81%, kuma an kama kurakuran ƙididdiga biyu ta waɗannan gwaje-gwajen da aka yi a cikin sakin gaba.
Case 2 - AI ta yaudare gwajin. Tare da samfurin "jad tawagar", wani kwararre ya tambayi AI don lambar da ta wuce gwaje-gwajen data kasance amma ta keta ka'idar rangwame. AI ta rubuta lambar wacce koyaushe tana mayar da ragi na sifili - kuma duk gwaje-gwajen sun kasance kore saboda babu gwaje-gwajen da ke tabbatar da ainihin ƙimar ragi. An gani tazara, an ƙara tabbatar da gaske.
Case 3 - Tarkon yabo. Wani ƙarami mai gwadawa ya tambayi AI, "Shin gwaje-gwaje na sun yi kyau?" sai ya huce da jin amsar da ake cewa, "Sosai m." Babban abokin aikin nasa ya sami irin waɗannan gwaje-gwajen ta hanyar amfani da samfurin "ƙwaƙwalwar gwaji"; Ya bayyana cewa 12 daga cikin 20 gwaje-gwajen an yi ado ne (ba tare da fa'ida ko takarce ba). Tambayar da ta dace ta kawo amsar da ta dace.
Kuskuren gama gari
- Iyakar kuskure don inganci. Dogaro da babban layin layi da rashin kallon makin maye gurbin kwata-kwata.
- Amincewa da yabon AI. Tambaya "Shin gwaje-gwajenku sunyi kyau?" da kuma la'akari da amsa mai kyau a matsayin tabbaci.
- Samo ƙimar da ake tsammani daga lamba. Gwajin tabbatar da kai wanda ke tabbatar da kuskuren lamba.
- Yi wadar zuci da ƙwazo. Takaddun da ba su tabbatar da ainihin ƙa'idar ba, kamar "ba banza", "200 sun dawo".
- Yin watsi da maye gurbi masu tsira. Yin watsi da abin da ba a kama ba a cikin rahoton maye gurbi.
- Ba ma ƙoƙarin canza lamba mai mahimmanci da hannu ba. Tsallake matakin "karya lambar kuma gwadawa" idan babu kayan aiki.
a takaice
Pseudo-trust yana gaskata cewa software daidai ne saboda gwaje-gwajen kore ne; alhali gwaje-gwajen ba za su iya tabbatar da komai ba. Ma'aunin gwal don auna wannan shine gwajin maye gurbi: karya lambar da gangan da auna ko gwaje-gwajen sun kama. Makin maye gurbin shine ma'aunin inganci mafi gaskiya fiye da ɗaukar nauyin kashi. AI duka suna haifar da amana kuma sun zama ƙungiyar ja mai ƙarfi wajen farautar ta - tambayi "samar da kwaro wanda ya wuce waɗannan gwaje-gwaje." Gwada gwaje-gwajen ku: hujja ta gaskiya, ƙimar da ake tsammani mai zaman kanta, ingantaccen tsarin kasuwanci, da maye gurbi.
Aikin aikace-aikace
Shigo da aiki mai ɗauke da dokar kasuwanci da gwaje-gwajensa daga aikin ku. Idan zai yiwu, gudanar da kayan aikin maye gurbi (Stryker/Pist/mutmut) kuma auna ma'aunin maye gurbin; Idan babu kayan aiki, samar da aƙalla maye gurbi guda 8 tare da samfuri " sarrafa maye gurbi" kuma gwada su da hannu. Ga kowane maye gurbi mai rai, rubuta sabon gwaji tare da samfurin "kashe maye gurbi". A ƙarshe, tare da tsarin "jad tawagar", duba idan AI zata iya samar da lambar da ke yaudarar gwaje-gwajen ku. Ba da rahoton maki farawa da ƙarshen maye gurbin ku (ko kama/ jimlar adadin maye gurbi).
jerin abubuwan dubawa
- [ ] Na kimanta ingancin gwaji ta hanyar maye gurbi, ba ɗaukar hoto ba.
- [ ] Na gudanar da gwajin maye gurbi (ko dai ta kayan aiki ko da hannu) don lamba mai mahimmanci.
- [ ] Na rubuta sababbin gwaje-gwaje don kowane maye gurbi mai rai.
- [ ] Na yi amfani da AI a matsayin ƙungiyar ja kuma na nemo madaukai a cikin gwaje-gwaje na.
- [ ] Ban ɗauki AI's "gwajin ku na da kyau" yabo a matsayin tabbaci.
- [ ] Na duba cewa kowace gwaji ta tabbatar da ainihin ikirari, ƙimar da ake tsammani mai zaman kanta, da tsarin kasuwanci.