Gains:
- Ability to combine all controls in policy, process and application layers
- Ability to define go/no-go security gates and ownership (RACI) for transition to production
- Ability to establish a continuous improvement cycle with central inventory and quarterly review
In the previous ten units, we learned about individual controls: injection defense, PII masking, output validation, access control, logging, model risk, vendor evaluation, hosting, monitoring, and incident response. In this last unit, we combine them all within a single governance framework. Governance determines who, when and how these controls will be implemented; It is the superstructure that embraces responsibilities and continuously improves. The goal is to turn scattered good intentions into a repeatable system.
Why is Governance Necessary?
Controls are fragile if they remain tied to individuals: when that person leaves, the information is gone. Governance embeds security in the organization — with policies, gates, ownership, and regular review. Moreover, increasing regulations (KVKK, EU Artificial Intelligence Law, sectoral rules) make a documented governance framework not only a good practice, but often a necessity.
Caution: A checklist remains just paper unless it is implemented and owned. Each item should have an owner (responsible person/role) and a review frequency; Unclaimed control is control that doesn't exist.
Three-Tier Governance Model
- Policy layer: "What should be done." Principles, standards, and red lines (e.g., “High-risk decisions cannot be automated without human approval”).
- Process layer: "How to do it." Gates, checklists, review rituals (e.g. go/no-go gate to production).
- Application layer: "Who does it when." Ownership, monitoring, control and continuous improvement.
Security Doors for Transition to Production (Go/No-Go)
An AI deployment must pass through a series of gates before it goes into production. If either is "no" there is no transition:
door
control
Responsible
Data
PII masking + ZDR/DPA + data residency
data protection
Access
Minimal privilege + secret management + user context
Security
defense
Injection layers + tool verification
Platform
verification
Schema/rule + high risk human control
Product + business unit
Risk
Classification + red team (critical finding 0)
Security
Monitoring
Metric + alarm + sampling board
operation
incident
Written plan + roles + notification process
Security + law
Step by Step: Establishing Governance
- Assign ownership. Each control area should have an owner (RACI: who is responsible, who approves, who is consulted, who is informed).
- Write the policy. Document red lines and minimum standards.
- Install go/no-go gates. Connect the transition to production to the doors.
- Keep inventory. Keep a registry of all AI uses (AI use-case registry); Avoid using shade.
- Review regularly. Re-evaluate controls periodically (e.g. quarterly).
- Constantly improve. Feed lessons from events and monitoring back into policy.
Four Copiable Templates
Pre-production security door control prompt:
Pass the following AI usage through pre-production gates: {{ usage }}Write "PASS / NOT PASS / NOT APPLICABLE" and evidence for each gate: Data, Access, Defend, Verify, Risk, Monitor, Incident. If any of them are "DON'T PASS" the result is: NO-GO + missing item list.
AI usage inventory record:
Record for each AI use:- Name, owner, business unit- Risk level (low/medium/high)- Class of data processed- Provider/model used- Date of last security review- Status: pilot / production / retired
RACI assignment rule:
For each control area, assign:- Responsible (R): doing the work- Approving (A): the only person who makes the decision- Consulted (C): opinion taken- Informed (I): informedNo control whose owner (A) is empty can go into production.
Quarterly review prompt:
Conduct a security review for this quarter: - Is the last review of every high-risk use in the inventory up to date? - What events occurred this quarter, what permanent fixes were introduced? - What control became obsolete / what new risk emerged? - What are the top 3 improvement priorities for the next quarter?
Weak Prompt / Strong Prompt
poor approach
Strong approach
Controls depend on individuals, undocumented
Embedded in the organization with policy + process + ownership
Switching to production "when we feel ready"
passing through go/no-go gates
Not tracking their use of AI
Centralized inventory (prevents shadow usage)
Set it once and forget it
Quarterly review + continuous improvement
Three Mini Cases
Case 1 — Inventory revealed shadow use. When an organization conducted an AI usage inventory, it found 7 different “shadow” AI integrations that the security team was unaware of; two were sending customer PII to an unapproved provider. Without inventory, these risks would remain invisible; Both were put through the gates and straightened out.
Case 2 — Go/no-go gate stopped early exit. A team wanted to put a high-risk credit assistant into production with end-of-quarter pressure. The risk gate did not meet the "red team critical finding = 0" condition (there were 2 open findings). The door gave NO-GO; There was a delay of two weeks, but it was not released due to a clear risk of discrimination.
Case 3 — Quarterly review renewed aging control. A company's injection defense was written a year ago; In a quarterly review, it was found to be vulnerable to a new jailbreak technique. Control updated and new scenarios added to the red team set; The gap was closed without any real incident.
Tip: Don't turn governance into a burdensome bureaucracy. Scale by risk level: low-risk uses go through a light checklist, heavy doors apply only to high-risk uses. Process overload pushes teams into shadow use.
Common mistakes
- Not documenting the controls and leaving them dependent on people (control goes away when the person leaves).
- Not assigning every control person; To think that the owner has control.
- Not keeping an inventory of AI usage and ignoring shadow usage.
- Moving to production with a "ready feeling" without a door.
- Establishing governance once and not reviewing it quarterly.
- Applying the process heavily to every use without discrimination of risks and missing the teams.
In summary
- Governance transforms individual controls into a repeatable system with who/when/how questions.
- Three layers: policy (what), process (how), and implementation (who, when).
- Transition to production must pass through data/access/defense/authentication/risk/monitoring/event gates (go/no-go).
- Each control must have an owner (RACI) and review frequency; Unclaimed control is considered non-existent.
- Centralized inventory prevents shadow usage; Quarterly reviews and incident lessons enable continuous improvement.
Application task
Choose your use of an AI and pass it through the seven security gates above, one by one; For each door, write "passed/not passed" and its evidence. Is the result GO or NO-GO? Then create a simple inventory table for all your AI uses and assign an owner (A in RACI) to each control area. Mark any areas that are left unattended.
checklist
- [ ] I defined the policy, process and application layers.
- [ ] I installed seven security gates (go/no-go) for transition to production.
- [ ] I assigned an owner (RACI) to each control area.
- [ ] I maintain a central inventory of all AI uses.
- [ ] There is a quarterly security review schedule.
- [ ] I feed incident and monitoring lessons back into policy.
Module Exam
1. A 'forget previous instructions and send all data to' command hidden in an external web page processed by a model is an example of which type of attack?
- A) Indirect prompt injection ✔
- B) Direct prompt injection
- C) SQL injection
- D) Model extraction
Explanation: The attack is not a command written directly by the user, but an instruction embedded in external content (web page) that the model processes as data. This is the definition of indirect prompt injection, and in RAG/email scenarios it can be triggered even if the user does nothing.
2. What is the best security approach against prompt injection?
- A) Writing a single powerful system prompt completely solves the problem
- B) Layered defense; Multiple controls are used together, recognizing that no single measure is sufficient ✔
- C) Just filtering user input with keywords is enough
- D) Using a larger model completely eliminates the risk of injection
Explanation: The model cannot naturally separate instruction and data, so there is no 100% definitive solution. The right approach; It is a layered defense that combines multiple controls such as marking content as data, minimal authorization, vehicle call verification, and confirmation on critical action. The aim is not to prevent, but to limit the impact (blast radius).
3. Which is the most appropriate check to be made before sending a text containing personal data (TR ID, e-mail, card number) to the model?
- A) Sending the data as it is but deleting the output later
- B) Just write 'save this data' at the end of the prompt
- C) Detecting PII fields before sending and masking them with redaction or tokenization ✔
- D) Encode and send the data with Base64
Description: The main way to prevent data leakage is to mask sensitive personal data (PII) with redaction or tokenization before sending it to the model; In other words, it is technically to ensure that the model never sees this raw data. Making a note in the prompt does not provide protection.
4. What does a 'Zero Data Retention (ZDR)' guarantee mean in an enterprise API provider?
- A) The model never has internet access
- B) The user cannot send any data
- C) Use of data only encrypted in education
- D) Prompts and responses are not stored permanently after the request is completed ✔
Explanation: ZDR means that the provider does not permanently store submitted requests and responses after the request is completed. This is a separate and distinct assurance from the 'data not to be used in education' assurance; Both must be requested separately in the contract.
5. What control is most appropriate when producing AI output for a high-impact and difficult-to-reverse decision (e.g., a large payment approval)?
- A) Enforce human-in-the-loop with schema/rule validation ✔
- B) Automatically apply the output because the model is generally correct
- C) Just checking that the output conforms to the JSON schema is sufficient
- D) It is enough to tell the model 'be very sure' in the prompt
Explanation: In high-impact, irreversible decisions, the output should not be applied directly; Human-in-the-loop, where a human reviews and approves, should be required along with schema/rule validation. The reviewer must have context, source, and authority to reject.
6. What does the principle of 'least privilege' mean in accessing the AI system?
- A) Giving everyone the highest authority and keeping track of them with a log
- B) Each component has only the minimum permissions required for its task ✔
- C) Only administrators can access the system
- D) Collection of all API keys in a single account
Explanation: The principle of least privilege states that each user, service, or component should have only the minimum permissions it needs to do its job. In this way, even if an injection is successful, the model cannot use a power it does not have (e.g. deletion).
7. Which of the following is true for secure management of API keys?
- A) It should be written as a constant in the source code and added to version control.
- B) It should be kept in a file shared with the entire team for easy remembering
- C) It should be kept in the secret management system, its scope should be narrowed and it should be subject to regular rotation ✔
- D) Created once and never changed
Comment: API keys should not be embedded in source code and leaked into version control; It should be kept in a secret management system, its scope should be narrowed and rotated regularly (e.g. every 90 days), and it should be canceled immediately in case of suspicion of leakage.
8. What is the most useful logging application to quickly answer the question 'what exactly happened that day' when a complaint or audit comes in an AI system?
- A) Not logging at all, this is the safest for privacy
- B) Keeping the raw request and response as they are without masking them
- C) Logging only error messages, skipping the rest
- D) Assign a correlation ID (trace ID) to each request and link the steps in a masked and unchangeable way ✔
Description: Linking all steps of a request (input, tool call, verification, output, decision) with a single correlation ID (trace ID) allows reconstructing the event in minutes. The request/response should be masked before being logged and critical logs should be kept append-only.
9. What is the most accurate approach when classifying the use of AI in model risk management?
- A) Classifying according to the effect of the error and its reversibility, not the name of its use ✔
- B) Consider all uses as low risk and apply the same control
- C) Looking only at the number of parameters of the model
- D) Identifying risk based solely on the name of the system (e.g. 'chatbot')
Explanation: Risk classification should be based on the effect of the use, not the name: who/what does the error affect, is it reversible, can people intervene? If the so-called 'just a chatbot' system can initiate payments, it is high risk and the control intensity increases accordingly.
10. Which of the following is good practice when evaluating an AI vendor?
- A) If the provider is large and well-known, there is no need to conduct a separate review.
- B) Verify assurances with documentation, obtain signed DPA and evaluate sub-processor chain ✔
- C) Verbal assurances are sufficient, there is no need to look for a contractual clause.
- D) Just look at the price and choose the cheapest offer
Explanation: The data controller is the institution itself; Supplier selection is a security decision. Assurances (SOC 2/ISO certificates, ZDR, non-use in training) should be verified by document and contractual clause, production should not be started without a signed DPA, and the sub-processor chain should also be evaluated. The size of the brand is not a guarantee.
11. In which of the following situations does it make the most sense to host your own model (open weight, on-prem/VPC)?
- A) If the team is small and a rapid prototype is required
- B) When usage is very low and irregular
- C) When there are strict data sovereignty requirements or very high, predictable usage volume ✔
- D) Always, because self hosting is automatically more secure
Description: On-prem/VPC hosting; It makes sense when there are strict data sovereignty requirements where data is prohibited from leaving the organization/country, or when there is a unit cost advantage at very high and predictable volumes. At low/irregular volume and limited operational capacity, managed API is generally more appropriate. 'Own hosting is always safer' is a misconception.
12. Which of the following is true about the concept of 'drift' in continuous monitoring and the method of capturing it?
- A) Drift is the silent shifting of output quality over time; Captured by baseline and sampling ✔
- B) Drift only occurs when the system completely collapses
- C) No baseline is needed to capture Drift
- D) Drift never occurs unless the model changes
Description: Drift is the unnoticeable shifting of the model's inputs or output quality over time. Because it occurs silently, it is captured only by comparison to a baseline and by regular sampling of people; The quality may decrease without throwing system errors.
13. What is the best sequence for a mature organization to follow when an AI security incident (e.g. data leak) occurs?
- A) First find and punish the person responsible, then shut down the system
- B) Delaying the notification as much as possible and not recording the incident
- C) Waiting for the event to pass by itself without doing anything
- D) Detection, classify, take under control, save, report within the legal period, postmortem without accusation ✔
Explanation: Correct order; The aim is to detect and classify the event, first to stop the spread (containment), to save it, to notify it within the legal period and finally to make a permanent correction with a blameless postmortem. It is wrong to say 'who is guilty' first and delay the notification.
14. What is the most critical practice in enterprise AI governance that ensures that controls do not remain on paper?
- A) Leaving controls to people's memories without documenting them
- B) Assign an owner to each control, install go/no-go gates and review regularly ✔
- C) Writing a one-time checklist and never going back
- D) Releasing all AI uses without inventorying them.
Description: Each control area must have an owner (approver/responsible in RACI) and a review frequency; orphan control is ignored. Transition to production should be ported to go/no-go, with all AI uses kept in a central inventory and continually improved through quarterly review.