Gains:
- Ability to transform a legal question into a researchable framework and do preliminary research with AI
- Ability to recognize the risk of fabricated jurisprudence/citation (hallucination) and verify each source from the primary text
- Ability to establish a workflow that uses AI as an idea generator and leaves the final authority to official sources
This unit carries the most critical warning of the entire module. Artificial intelligence (AI) can provide a fluent, convincing and highly confident answer to a legal question; The problem is that this response may be based on a non-existent statute, a fabricated court decision, or a false reference. This is called hallucination: when the model produces information that appears to be real but is actually fabricated. There are incidents in the world where lawyers present fake decisions made up by AI to the court, thinking they are real, and face fines, loss of reputation and disciplinary sanctions. That's why this unit has one iron rule: AI does preliminary research; The ultimate authority is always the primary source.
Let's clarify the terms. Case law is the decisions given by the courts in similar cases and are considered guiding. The primary source is the actual text of the law: the text of the law/regulation in force and the text of the official decision (e.g. Official Gazette, decision published by the court itself). Secondary sources are articles, commentaries and comments written on them. A citation is a formal reference to a decision or article (decision number, article number). Verification is the process of verifying each attribution given by AI from the primary source itself.
Why Is It So Dangerous?
AI is a language prediction machine, not a “database of facts.” He has learned what a decision number looks like, how to write a reasoning; Therefore, it can "produce" a decision that does not actually exist, in the correct format and with a convincing justification. And he does this in the same confident tone he uses when conveying an actual decision. So there are no apparent warning signs of a hallucination; Just because it "looks safe" doesn't mean it's trustworthy.
The second danger is timeliness: the AI's training data is cut off by a certain date. The model may not be aware of changed legislation, abolished articles or new jurisprudence after that date; However, the model may present old/incorrect information as current.
Caution: IGNORE an AI decision number, article number, or citation if it has not been verified from the primary source. There is no category of "probably true"; In law, the reference is either verified or unusable.
Secure Research Workflow
The way to use AI safely in legal research is to position it as a “thinking partner” rather than an “answering machine.” Step by step:
- Frame the question. Clarify the event, the legal question and which area of law (business, commercial, debts) you are asking.
- Use AI as an idea/framework generator. Possible arguments, concepts to look at, opposing views.
- Don't ask for concrete references — ask for a search term. Instead of asking the AI to make up a decision number, ask for key concepts and terms that you will search in the official database.
- Verify each source from the primary. Every item/decision made is confirmed by the official legislation and decision text.
- Check for up-to-dateness. Check whether the article is in effect and whether it has changed.
- The final view is created by humans. AI produces draft arguments; Legal opinion and responsibility belong to the lawyer.
Your role: a legal research assistant. YOU ARE NOT the final authority.Topic: [brief summary of the case and legal question].Do:1) List the legal concepts and possible lines of argument that should be looked at to analyze this question.2) Suggest KEY TERMS and concepts that I will look for in official legislation and decision databases (decision/citation number FITTING).3) Also write down the possible arguments of the opposing side.If you give an exact law article or decision number, write “VERIFIED — confirm from primary source” next to it. If you are not sure, say "I don't know"; Don't guess.
If AI still produces concrete attributions, it is necessary to place them in a verification queue. Making the AI itself say “verify this” is not verification; Verification is done by humans, on the official source.
Below are the references I intend to use in my draft argument. Produce a VERIFICATION CHECKLIST for each: (a) what official source should be sought, (b) what needs to be confirmed (effectiveness of the article, existence of the decision and its subject matter), (c) what to do if it cannot be verified. DO NOT assume attributions are correct; just tell me how to verify.
Weak Prompt / Strong Prompt
Weak prompt: Give the precedent Supreme Court decisions and relevant articles on this subject with their numbers.
Result: decision numbers and articles appearing in the correct format, with convincing reasoning, but which may be wholly or partially fabricated. Using them without verifying them is a serious professional mistake.
Powerful prompt: [assistant role + "you are not the final authority" + concept/argument analysis + search term instead of decision number + "MUST VERIFY" tag + "if you're not sure, say I don't know" + separate verification checklist]
Result: A research support that speeds up your thinking but does not drag you into fabricated references, and puts every concrete information in the queue for verification.
Where to Use AI and Where Not to Use it
Quest
Is AI suitable?
Why
Argument/counter argument generation
Yes (draft)
Provides diversity of ideas
Suggesting concepts and search terms
Yes
Speeds up research
Simplify/summarize text
Yes (with verification)
Based on the given text
Concrete decision/article number
No (without verification)
High risk of hallucinations
Latest version of current legislation
No (alone)
Training data may be outdated
Final legal opinion
no
Responsibility and authority belong to people
Three Mini Cases
Case 1 — Fraudulent decisions. A lawyer asked the AI for "precedent decisions" in support of a petition and added 4 of the 6 decisions to the petition without verification. When the opposing party showed that none of the decisions existed, the lawyer both lost confidence in the case and faced the disciplinary process. Subsequently, the bureau made it a written policy that "no attribution from AI enters the file without verification from the primary source"; the next quarter, the number of unverified citations dropped to zero.
Case 2 — Repealed article. A compliance expert was about to set up a process based on a regulation article that AI had referenced. During the update check, he realized that the article had been changed a year ago; The AI's training data was outdated. The expert set up the process according to the current text. Lesson: AI regulatory information is a “snapshot” and may be outdated.
Case 3 — Correct use. A legal team used AI solely to generate an argument map and search term on a complex competition law question. The AI suggested 9 concepts to look at and 4 possible counter-arguments; The team found and verified actual decisions in these terms in the official database. The conceptual preparation phase of the research was halved; but no attribution was used without verification from AI. Speed gained, reliability maintained.
Common mistakes
- Asking for the decision/item number directly from the AI and using it without verification. This is the most common and most serious mistake.
- Trusting, "He seems sure." Confident tone is not evidence of truthfulness.
- Bypassing the freshness check. Regulatory knowledge of AI is frozen in the history of education; may miss changes.
- Have the AI verify its attribution. It cannot reliably detect model error on its own; Verification is done on the official source.
- Mistaking AI for the ultimate authority. AI is a preliminary research tool; Legal opinion and responsibility lies with the human being.
- Not keeping trace of source. Not recording which attribution was verified from where creates a gap in auditing and defense.
In summary
In legal research, AI is a powerful thinking partner but a dangerous “answering machine.” The biggest risk is hallucinations, that is, fabricated judgments and attributions; The second is timeliness, that is, the training data is out of date. The safe path is clear: use AI to generate arguments and search terms, never use concrete references without verification, verify each source from the primary text, and let the human form the final opinion. AI accelerates research; The primary source and qualified professional decide what is real and valid.
Application task
Choose a legal question (factual or example). (1) Get concept map, search terms and counter-arguments from AI with secure research prompt; Verify that it does not provide a decision number. (2) If the AI still made an item/decision, place it in a validation queue with the validation checklist prompt. (3) Confirm an authentic source by searching an official source with at least three of the suggested search terms. (4) Write the rule "No attribution from AI is used without verification" into your own workflow.
checklist
- [ ] Is AI positioned as a research assistant rather than the ultimate authority?
- [ ] Were a concept and search term requested instead of a concrete reference?
- [ ] Is every item/decision the AI makes marked "MUST BE VERIFIED"?
- [ ] Has each citation been verified from the primary (official) source?
- [ ] Have the articles been checked for currency/validity?
- [ ] Was the final legal opinion established by a human?
- [ ] Are verification sources and trace recorded?