News Summary
A recent study reveals that general-purpose AI models have now passed the CFA Level III exam, a significant achievement in finance. This breakthrough, documented by researchers from NYU Stern and Goodfin, highlights improvements in AI performance, as they previously struggled with the complexities of Level III. The findings suggest that AI could complement human expertise in financial advising, addressing concerns about job impacts as graduates enter the field with optimism. The study emphasizes the need for explainability in AI systems as they play an increasing role in financial decision-making.
New York – A groundbreaking study has revealed that general-purpose AI models have successfully passed the CFA (Chartered Financial Analyst) Level III exam, recognized as one of the most challenging assessments in the finance sector. This significant milestone was documented in a paper co-authored by Srikanth Jagabathula, a professor at NYU Stern School of Business, and produced in collaboration with Goodfin, an AI-assisted wealth management platform.
The research aimed to evaluate the capabilities of large language models (LLMs) in rigorous and specialized domains like finance. Prior studies revealed that while these AI models had previously passed CFA Levels I and II, they notably struggled with the complexities of Level III. The recent findings indicate a marked improvement in the models’ performance, demonstrating that they can now successfully navigate this demanding examination.
The CFA exam serves as a gold standard benchmark within the financial advisory industry. The Level III portion comprises both multiple-choice questions and essay questions that require a nuanced evaluation of responses. The evaluation of multiple-choice questions was relatively straightforward, utilizing an answer key for accuracy. In contrast, assessing essay responses posed a greater challenge; this element of the study involved a sophisticated model acting as an evaluator alongside CFA Level III certified graders to ensure a thorough assessment.
The findings revealed that LLMs tended to grade essay responses more stringently than human graders, resulting in lower average scores. The evaluation also highlighted the importance of prompting techniques on the models’ performance, particularly the “chain-of-thought” prompting method. In this approach, LLMs are encouraged to articulate their reasoning prior to providing answers, which has shown to yield enhanced outcomes.
While the performance of the models on multiple-choice questions was closely grouped, a greater disparity was evident among essay responses, allowing researchers to differentiate between more capable models and their lesser counterparts. To mitigate any potential data leakage, the researchers selected the CFA exam to ensure the LLMs had not encountered the specific questions during training.
The study concluded with an encouraging observation indicating that LLMs are poised to complement existing expertise in financial advice rather than entirely replace human professionals. This insight arrives at a time when graduates entering the finance field harbor optimism about their future careers yet express concerns about the potential impact of AI on job availability. Many believe that having AI expertise may enhance their employment prospects.
A survey found that an overwhelming 93% of graduates aspire to pursue careers that positively impact society, reflecting a growing interest in the finance sector. Financial security is regarded as a priority, with 58% of graduates emphasizing the importance of salary and flexible work arrangements in their job choices.
The CFA Institute underscored the critical need for explainability in AI systems as their applications become increasingly prominent in financial decision-making. Maintaining public trust as these technologies evolve will be essential for their further integration into the finance industry.
As the capabilities of AI continue to advance, this study marks a notable progress point, suggesting a future where AI can effectively assist in complex financial tasks, ultimately enhancing the quality of financial advice available to consumers.
Deeper Dive: News & Info About This Topic
HERE Resources
New York Proposes FAIR Business Practices Act for Consumer Protection
Jackie Gleason’s Unique Home Listed For Sale
New York City Faces Significant Rental Crisis as Prices Surge
New York City Faces $13 Billion Tax Revenue Loss
GEICO Sues Advanced Supplies for $620,000 Fraud Allegations
Former Controller Charged with Embezzling Nearly $100,000
State Auditor Charged with Grand Larceny in Wallkill
Trump’s Financial Shift: A Leap into Cryptocurrency Ventures
Boca Raton Mayor Aims to Attract NYC Businesses
New York to Host Autosport Business Exchange Series
Additional Resources
- Investment News
- Wikipedia: Artificial Intelligence
- Proactive Investors
- Google Search: AI in finance
- Fund Selector Asia
- Google Scholar: Finance and AI
- Kiplinger
- Encyclopedia Britannica: Finance
- The Globe and Mail
- Google News: Careers in finance
Author: STAFF HERE NEW YORK WRITER
NEW YORK STAFF WRITER The NEW YORK STAFF WRITER represents the experienced team at HERENewYork.com, your go-to source for actionable local news and information in New York, the five boroughs, and beyond. Specializing in "news you can use," we cover essential topics like product reviews for personal and business needs, local business directories, politics, real estate trends, neighborhood insights, and state news affecting the area—with deep expertise drawn from years of dedicated reporting and strong community input, including local press releases and business updates. We deliver top reporting on high-value events such as New York Fashion Week, Macy's Thanksgiving Day Parade, and Tribeca Film Festival. Our coverage extends to key organizations like the Greater New York Chamber of Commerce and United Way of New York, plus leading businesses in finance and media that power the local economy such as JPMorgan Chase, Goldman Sachs, and Bloomberg. As part of the broader HERE network, including HEREBuffalo.com, we provide comprehensive, credible insights into New York's dynamic landscape.
