iCreatAI News
Skip to content
Hacker News AI· marojejian·· 11 days agoAI score58

New Research Tests Whether AI Models Know Their Own Thoughts

New Research Tests Whether AI Models Know Their Own Thoughts

AI summary

Researchers are testing whether large language models can introspect by injecting "thoughts" into their neural networks, with Anthropic's Jack Lindsey finding that Claude models correctly flagged injected concepts in about 20% of trials while never producing false positives in control groups. Follow-up work by Kyle Mahowald and Harvey Lederman suggested the models' descriptions of injected concepts may stem from steering effects rather than introspection, though they found models can still detect that something unusual occurred in their internal processing—an ability they call "anomaly detection." Researchers remain divided on whether this counts as introspection and caution that any such capacity in language models may not resemble human introspection.

Source: Hacker News AI · quantamagazine.org