OpenAI’s ChatGPT made news again after getting a massive investment from Microsoft. The chatbot passes the US law school exam after writing essays on taxation, constitutional law, and more.
ChatGPT passes the US law school exam
ChatGPT using the data from the internet was successful in passing exams at a law school in the US after writing essays on several topics. The chatbot was created by OpenAI, an American firm that got massive funding from Microsoft. The application uses artificial intelligence (AI) for generating text from prompts. The results are impressive and educators are warning this may lead to cheating and bring the end of traditional learning methods.
Jonathan Choi, a Minnesota University Law School professor presented the same test faced by students to the chatbot. The test contains 12 essays and 95 multiple-choice questions. On Monday, the bot’s C+ results were published in the paper titled “ChatGPT goes to law school” by Choi and his colleagues. While the bot was at the bottom of the class, it “bombed” multiple-choice questions that involve math.
The AI bot’s report card
“In writing essays, ChatGPT displayed a strong grasp of basic legal rules. And had consistently solid organization and composition,” revealed the authors of the paper. However, the bot “often struggled to spot issues when given an open-ended prompt, a core skill on law school exams”. Officials in several jurisdictions including New York are banning the usage of the AI bot. However, Choi believes it could help as a teaching aide.
“Overall, ChatGPT wasn’t a great law student acting alone. But we expect that collaborating with humans, language models like ChatGPT would be very useful to law students taking exams and to practicing lawyers,” explained Choi. “(They) had a hunch and their hunch was right because ChatGPT had perfect grammar and was somewhat repetitive,” tweeted Choi om response to questions regarding cheating. According to the professor, two out of three makers were present in the paper written by the bot.