Equating legal work with text generation fails to acknowledge the reasons that lawyers “produce text,” nor the expertise required to do so. Lawyers do not generate text; they use language to achieve specific goals. It may take 10 minutes to write 5 sentences — but those 10 minutes often leverage 10 years of legal practice combined with 4–10 years of legal studies.
The use of Large Language Models in legal practice requires a cost-benefit assessment in terms of time and quality. When evaluating the speed with which an LLM generates its output, we must consider the time and human resources required for its verification.
Importantly the risk of hallucinations must not be underestimated. What would be an acceptable “hallucination rate” for your law firm? How would it translate into cost savings?
Similarly factually incorrect output can still be — or appear to be — relevant, plausible and informative; given these risks, the question is not whether LLMs can perform a particular task but whether they should be used to perform such a task
Source:Medium
Leave a Reply