Unit 12 / 12

Quality, Compliance and Confidentiality: Not Providing False Information

Gains:

  • Ability to establish safe boundaries that reduce the risk of misinformation on price, commitment and policy issues
  • Ability to design secure prompts and processes that protect customer personal data (KVKK compliant)
  • Ability to establish a quality assurance (QA) cycle that includes human approval and auditing

Customer-facing artificial intelligence (AI) is both a big opportunity and a big risk for a business. A mistake in a marketing copy can be corrected; But the wrong price given to a customer, wrong policy information or a promise that cannot be kept means direct loss of trust, financial damage and legal problems. The "bot told me" defense won't save you; It is the company's responsibility towards the customer.

In this final unit, we build a framework that secures everything you learned in the previous 11 units. It sits on three pillars: accuracy (not giving false information), privacy (protecting personal data) and control (human consent). These three are the safety belt that transforms AI from a source of risk into a reliable business tool.

Note: This unit provides a general framework. Regulations of your own industry (consumer rights, KVKK, commercial message rules) may impose additional obligations; The ultimate responsibility for compliance lies with your institution.

Three Risks, Three Pillars

  • Misinformation (hallucination): Model invents price/policy/commitment. Column: verified source + human approval.
  • Privacy violation: Customer personal data (name, phone number, ID, payment) enters the unsecured tool. Column: masking + approved vehicle (KVKK compliance).
  • Exceeding authority: The bot/agent makes a promise that it cannot deliver (discount, exact date, guarantee). Column: clear jurisdiction + guardrail.

Every customer contact AI flow must manage these three risks simultaneously.

Avoid Misinformation: Layer of Accuracy

The golden rule of accuracy: critical information (price, policy, commitment) comes from a verified source (remember the RAG unit), not from the model's memorization, and when unsure, the model remains silent and hands over. The principle of “secure or pass on” cuts off misinformation at the source.

Step by Step: A Safe Quality Cycle (QA)

  1. Classify by risk. Is the answer low risk (general information) or high risk (price, commitment, refund amount)?
  2. Put a human door on high risk. These responses require human approval before being sent.
  3. Connect to source. Critical information should be based on a verified document and not fabricated.
  4. Mask personal data. Do not enter if it is not necessary; Anonymize if necessary.
  5. Check by sampling. Some of the automated responses are regularly human-checked.
  6. Feed back. Collect errors and update prompts and guardrails.

Copiable Prompts

Prompt that scans for risks before sending the response:

Check and flag this customer response before posting:- Is there an unverified PRICE, rate or amount?- Is the policy/rule claim sourced, or could it be fabricated?- Are there any COMMITMENTS (exact date, warranty, discount) that exceed authority?- Is personal data (name, phone, ID, address, payment) included unnecessarily? List each finding with a "high/medium/low risk" label and a suggestion for correction.Response: {{ reply }}

Prompt masking personal data (before entering the vehicle):

Mask the personal data in the following text: name-surname -> [NAME], phone-> [PHONE], e-mail -> [EMAIL], TR/ID -> [ID], address -> [ADDRESS], card/payment -> [PAYMENT]. Preserve the meaning and technical detail of the problem. Text: {{ text }}

Guardrail prompt that directs high-risk issues to humans:

NEVER respond to these issues on your own; instead say "I'm passing this on to a representative": exact price/discount, contract/refund amount dispute, legal/medical/financial advice, change of personal data, security/suspicion of fraud. You can answer general knowledge questions outside of this list.

Sampling prompt for regular quality audit (QA):

Below are 10 random answers from the last X answers. For each, evaluate: accuracy (is it appropriate to the source), tone (is it empathetic/appropriate), rapport (is there any abuse/personal data leakage). Rank the problematic issues in order of importance and summarize the recurring error pattern (e.g., "he keeps making up deadlines") in one sentence. Answers: {{ examples }}

Weak Approach / Strong Approach

poor approach

Strong approach

Send all replies without approval

Human approval gateway for high risk

Matching the price/policy to the model

Link to verified source

Entering personal data into the vehicle as is

Mask up and drive with approval

Fixing errors one by one when they occur

Closing the root cause with audit + feedback

The difference is that the strong approach establishes a system that "prevents the error before it occurs" rather than "fixes it when it occurs".

Three Mini Cases

Case 1 — Fabricated refund amount. A bot said, "You will get 850 TL back when you return your product"; whereas the actual amount was different and the bot could not know that. The risk screening prompt had detected such "unconfirmed amount" output in previous tests. The team connected all responses containing amounts to the human approval gate; An incorrect refund figure was never sent to the customer again.

Case 2 — Masking protected privacy. A representative wanted to summarize a long complaint that included the customer's name, phone, and order information. He ran the masking prompt first; personal fields became [NAME], [PHONE] tags. The summary was of the same quality, but no personal data was unnecessarily introduced into the tool; A safe flow has been created in terms of KVKK.

Case 3 — Audit found root cause. In monthly QA sampling, the AI ​​picked up a recurring pattern: the bot asked “when will it arrive?” He was constantly making up deadlines in his head for his questions. This was not a singular error but a root cause. The team added the delivery date issue to guardrail and made a rule of "only transfer the date in the system, otherwise transfer". A single fix prevented dozens of future errors.

Tip: Keep the “high risk” list short and clear; but it must include: money (price, return, discount), time (exact delivery commitment), policy exceptions and personal data change. These four areas are where the most frequent and costly errors occur in customer-contact AI.

Where Does Responsibility Stop?

The most important principle is last: AI is a speed and quality multiplier, not a liability. Every promise, every price, every commitment made to the customer binds the company legally and commercially. That's why AI is kept in the position of "producing drafts and transmitting information" rather than "making decisions"; In critical decisions, human approval is not a luxury but a necessity. In a well-established system, AI handles 90% routine, human takes 10% critical decision and bears all the responsibility.

Caution: The idea that "when the model is developed enough, there is no need for human supervision" is dangerous. No matter how good the model is, it may occasionally produce a false confident tone; and in customer-contact business, all it takes is one wrong price or commitment. The human gateway to approval is not a sacrifice of speed, but the price of trust.

Common mistakes

  • Sending high-risk (price, commitment, returns) responses without human approval.
  • Not attributing critical information to the verified source and relying on the model's memorization.
  • Entering an unsecured vehicle without masking personal data (KVKK violation).
  • Not defining Guardrail (high risk subject list).
  • Fixing errors one by one and skipping updating the root cause (prompt/rule).
  • Thinking that it puts the onus on the AI ​​or the tool provider.

In summary

  • Customer-contact AI must manage three risks simultaneously: misinformation, privacy breach, overauthorization.
  • For accuracy: link critical information to verified source, delegate when unsure.
  • For privacy: mask personal data, use only approved and secure vehicles (KVKK).
  • Connect high-stakes issues (money, time, politics, personal data) to the human approval gate.
  • Check for errors by sampling and close the root cause; The ultimate responsibility always lies with the human being.

Application task

Prepare a “security suite” for your own customer contact flow: (1) write a guardrail list of high-risk topics (minimum money, time, policy, personal data), (2) run a sample customer response through a risk screening prompt and label the findings, (3) purge a text containing personal data with a masking prompt, (4) define a weekly QA sampling ritual (how many responses, who checks, where errors are recorded). Finally, list what types of decisions will never go without human approval.

checklist

  • [ ] I have defined a guardrail list for high risk topics.
  • [ ] I have linked critical information to verified source.
  • [ ] I masked personal data and used only approved vehicles.
  • [ ] I put a human approval gate on high-risk answers.
  • [ ] I have established regular QA sampling and feedback loop.
  • [ ] I made it clear in the process that the ultimate responsibility lies with the human.

Module Exam

1. What is the most critical element when writing a system prompt for a customer support chatbot?

  • A) Clearly define the bot's role, scope, boundaries and handing it over to the human when it does not know it ✔
  • B) Requiring the bot to provide an answer to every possible question
  • C) Keeping the system prompt as short as possible and not giving details
  • D) Making the bot humorous and friendly in all situations

Explanation: The bot's role, scope and especially its limits (what it cannot do, when it will be handed over to humans) should be clearly defined. Otherwise, the bot may make unauthorized commitments or produce false information on a subject it does not know.

2. What is the best way to get consistent and automated results when classifying tickets with artificial intelligence?

  • A) To summarize each request as free text, without imposing format
  • B) Giving predefined categories, fixed urgency levels and an immutable output format ✔
  • C) Leave the category list to the model and let it find it on its own each time.
  • D) Sorting requests by length only

Description: Giving the model a predefined list of categories, fixed urgency levels, and an immutable output format (e.g. JSON) ensures a consistent and machine-processable result across different requests. Dropping the category into the model produces different tags each time.

3. What is the main purpose of the RAG (knowledge-based production / Retrieval-Augmented Generation) approach?

  • A) Enabling the model to give more creative and original answers
  • B) Shortening the response time of the model
  • C) Base the model's response on up-to-date and verified source documentation provided ✔
  • D) Requiring the model to connect to the internet under all circumstances

Explanation: RAG does not memorize the model's answer; It enables it to produce updated and verified source documents retrieved at the time of the question. This increases accuracy and greatly reduces fabricated information (hallucination).

4. While generating an answer from the knowledge base, what should the model do if the answer to the question is not available in the given resources?

  • A) Making up a guess that seems reasonable from his general knowledge
  • B) Copying and giving a ready-made answer on a similar subject
  • C) Leaving the question unanswered and silently closing the conversation
  • D) Stating that he/she does not have the information and directing the customer to the correct source/authority ✔

Explanation: The model should not fabricate information that is not in the source; It should clearly state that it does not have the information and direct the customer to an official or the right source. This eliminates the risk of misinformation.

5. What is the best approach to drafting a support response to an angry customer?

  • A) Going straight to the technical solution and ignoring the emotion
  • B) Explaining in a defensive manner that the customer is at fault
  • C) Keeping the response as formal and distant as possible
  • D) First recognize the emotion with empathy, then offer a clear solution or next step ✔

Explanation: It is necessary to first recognize the emotion and show empathy, then clearly present the concrete solution or next step. Jumping straight to the technical solution or ignoring the emotion increases tension.

6. What is the best change when adapting a support response to live chat instead of email?

  • A) Copying the text verbatim, without changing it, into the chat
  • B) Make the text more formal and add a signature block and subject heading
  • C) Shortening and dividing the text to adapt it to the tempo of the speech and the next step ✔
  • D) Give as much technical detail as possible in one message

Description: Live chat is short, fast and conversational. Long e-mail blocks; Converting messages into short, fragmented, and focused on a single next step is appropriate for the channel. Moving the same text from channel to channel without changing it spoils the experience.

7. What is the healthiest approach when qualifying a potential customer (lead) with artificial intelligence support?

  • A) Framing the AI output (ICP/BANT) and marking assumptions that need to be verified ✔
  • B) Processing all AI-generated information into the CRM as real without verifying it.
  • C) Making the qualification only based on the number of employees of the company
  • D) Sending the same general message to every lead and skipping qualification

Description: AI can produce a structured briefing from publicly available information; but this output may contain assumptions. It is correct to use the qualification result by marking the assumptions that need to be verified and placing them in a framework such as ICP/BANT. It is risky to accept the output as real without question.

8. What is the most important principle in an effective cold sales email?

  • A) Explaining all the features and achievements of the company in detail
  • B) Focus on the buyer's problem/goal, keep it short and give one clear CTA ✔
  • C) Sending the same general text to as many people as possible
  • D) Share a detailed price list immediately in the first e-mail

Description: Effective sales emails are receiver-focused, not sender-focused: they address a customer problem or goal, are short and personalized, and include a single clear next step (CTA). Listing all the features of the company will miss the buyer.

9. When preparing an offer/suggestion text with artificial intelligence, what is the element that increases the persuasive power of the output the most?

  • A) Just listing a long list of specifications
  • B) Keeping the offer general and vague enough to suit every customer
  • C) Do not write the price at all and only add complimentary sentences
  • D) Establishing a benefit-oriented narrative that connects to the customer's needs and goals ✔

Explanation: Writing the offer in a benefit-oriented language that connects to the customer's needs and goals increases its persuasive power. Providing just a list of specifications will make the customer wonder 'what does this get me?' leaves him alone with his question.

10. What is the best approach when preparing an AI response to a sales objection (“Your price is too high”)?

  • A) Ignore the objection and move on to another topic
  • B) Offering a large discount immediately and unconditionally
  • C) Respond customer-specifically by recognizing the objection and reframing the value/benefit ✔
  • D) Accusing the customer of not understanding the product

Clarification: It is effective to first recognize the objection, then reframe the value/benefit and offer a customer-specific response. Giving a big discount immediately reduces the value; Ignoring objection destroys trust.

11. What is the most valuable output expected from artificial intelligence when processing interview notes into CRM?

  • A) Structuring notes as summary, decisions, next steps and responsibilities ✔
  • B) Copying the notes as they are, without any changes
  • C) Just making the notes longer and more fancy
  • D) Only record the duration and time of the conversation

Description: Scattered notes; Putting it in a structured format such as summary, decisions made, next steps (actions) and those responsible makes it easier for the team to follow. Copying the note as is or simply extending it does not produce value.

12. What is the best way to ensure 'not giving false information' in an artificial intelligence output that comes into contact with the customer?

  • A) Giving the model full authority and letting it make every commitment on its own
  • B) Limiting critical information to verified sources, delegating when unsure, and adding a layer of human approval ✔
  • C) Remove all checks for speed and send the output directly
  • D) Waiting for correction later if incorrect information is revealed

Description: Model; Critical information such as price, policy and commitment should not be fabricated, but should only be obtained from verified sources and should be handed over to humans when unsure. Critical responses should have a layer of human validation.

13. What should a support specialist do if he wants to have the artificial intelligence tool summarize a customer's complaint containing name, phone number and order information?

  • A) Paste the information as it is and get the fastest result
  • B) Assuming that adding the phrase 'confidential' at the end of the text is sufficient
  • C) Masking and anonymizing personal data and/or using an approved tool with corporate assurance ✔
  • D) Thinking that sending the information and then deleting the conversation eliminates the risk.

Explanation: Personal data (within the scope of KVKK) should not be entered into third-party tools unnecessarily. The right approach; masking and anonymizing identity information and/or using an approved tool with corporate data assurance (not using data in education, storage policy).

14. What is the best principle when designing a multi-step sales follow-up sequence?

  • A) Sending the same reminder message every day
  • B) Add a new value in each message and proceed at reasonable intervals ✔
  • C) Continuously increase the message frequency until a response is received.
  • D) If the first response is not received, fit the entire series into one long email.

Description: Each follow-up message should proceed by adding a new value (content, case, different angle) and should be sent at reasonable intervals. Repeating the same 'just a reminder' message in short bursts is overwhelming and reduces response rate.

15. What should be the role of AI when establishing a quality assurance (QA) cycle for support and sales teams?

  • A) AI generates draft; Critical responses are reviewed and approved by humans, responsibility lies with humans ✔
  • B) AI sends all responses without confirmation; People only look when there are complaints
  • C) If AI is advanced enough, there will be no need for human supervision.
  • D) The responsibility lies with the software company that provides the tool

Description: AI generates response drafts and improves consistency; however, critical responses to the customer, especially those involving price/commitment/policy, should be reviewed and approved by a human. The ultimate responsibility always lies with the human team.