ChatGPT Passed Exams From Graduate Business and Law Schools

That said, the AI didn’t necessarily ace the exams with flying colors, averaging about a C+ performance overall.

Credit: Frederick Florin / AFP / Bloomberg via Getty Images
Credit: Frederick Florin / AFP / Bloomberg via Getty Images

ChatGPT, the artificial intelligence tool that has been used in everything from high school essays to a speech on the floor of Congress, has added another accomplishment to its résumé: passing exams from law and business schools.

The AI tool was presented with several tests from both the University of Minnesota’s law school and the University of Pennsylvania’s Wharton School of Business, passing them all.

That said, the AI didn’t necessarily ace the exams with flying colors. The chatbot answered 95 multiple choice questions and 12 essay prompts across 4 of UM’s law school tests, averaging about a C+ performance overall. The tech did better in Wharton’s business management course exam, scoring between a B to B-.

Wharton professor Christian Terwiesch outlined ChatGPT’s performance in a short paper published to Wharton’s website. He said the AI did an “amazing job at basic operations management and process analysis questions, including those that are based on case studies,” adding that “not only are [ChatGPT’s] answers correct, but the explanations are excellent.”

However, he also found that the chatbot made “surprising mistakes” when it came to “relatively simple calculations at the level of 6th grade Math.”

“Third, the present version of ChatGPT is not capable of handling more advanced process analysis questions, even when they are based on fairly standard templates. This includes process flows with multiple products and problems with stochastic effects such as demand variability,” Terwiesch’s findings continued. “Finally, ChatGPT is remarkably good at modifying its answers in response to human hints.”

Since it first gained publicity in late 2022, school administrators and teachers at varying levels of education have sounded the alarm on ChatGPT and its potential to upend education. Public schools in New York City have banned anyone from using the AI on the school district’s networks and devices.

Terwiesch himself seems to approve of such bans. “After all, when you give a medical doctor a degree, you want them to know medicine, not how to use a bot. The same holds for other skill certification, including law and business,” he told CNN.