A new Review discusses how concepts and methods borrowed from psychology can inform research to evaluate whether and how large language models (LLMs) can employ reasoning. "The ever-growing capabilities of these systems make them challenging but also increasingly important to understand and explain, especially since these expanding capabilities also bring greater potential for unforeseen harm," Thilo Hagendorff and colleagues write. Their proposed approach – called "machine psychology" – advocates for seeking inspiration from the behavioral sciences. Since psychology's protocols already assess emotional, cognitive, and social development, they could be modified to examine LLMs' intelligence, biases, decision-making, social skills, and language. Hagendorff et al. urge caution, though: "Many psychological concepts are normatively laden and can foster mismatches in expectations between AI experts and the public regarding machine capability."
Psychology Could Help Measure LLMs' Thinking Capacity
American Association for the Advancement of Science (AAAS)
/Public Release. This material from the originating organization/author(s) might be of the point-in-time nature, and edited for clarity, style and length. Mirage.News does not take institutional positions or sides, and all views, positions, and conclusions expressed herein are solely those of the author(s).View in full here.
