A basic case for accelerating conceptual reasoning capabilities

The authors argue that many of the most important alignment and safety challenges have indispensable conceptual components—questions without accessible ground truth that rely on a priori argumentation—while AI R&D and takeover depend much less on such reasoning, so improving AI's conceptual reasoning would be differential. They claim this work is neglected and tractable, citing initial results where basic elicitation and small-scale training made models roughly three to twelve months better on their main conceptual reasoning benchmark, and they point to a follow-up post on how to work on the problem.