It is clear to anyone who has used GPT-4 (particularly 32k+), that the capabilities of LLMs are likely to have significant utility in the world of professional services. While the precise scale and scope of that utility is subject to evaluation, the notion that LLMs will reshape the work of professionals appears evident.
Three recent studies have attempted to measure the efficacy of GPT-4 in completing tasks and enhancing productivity.
- GPT-4 Passes the Bar Exam – found not just the rapid and remarkable advance of large language model performance generally, but also the potential for such models to support the delivery of legal services in society.
- Harvard/BCG explored the practicality of AI tools, specifically Large Language Models (LLMs) like GPT-4, for realistic knowledge work.
- the University of Minnesota examined how AI assistance impacts their legal analysis skills across various tasks. Participants – law students to be specific – were randomly assigned sixty students to complete four legal tasks each – draft a complaint, a contract, an employee handbook section, and a client memo – with or without GPT-4 assistance.
In this post, the latest studies are highlighted and considers what, if anything, they might tell us about the path forward for Generative AI in legal services.
Source: Kelvin Legal
Leave a Reply