Alexander Lerchner, a researcher at Google’s DeepMind division, posted a preprint article a couple of months ago titled “The Abstraction Fallacy: Why AI Can Simulate But Not Instantiate Consciousness”, in which he makes the strong claim that computationally based AI will never be conscious. Here’s the abstract:

Abstract

Computational functionalism dominates current debates on AI consciousness. This is the hypothesis that subjective experience emerges entirely from abstract causal topology, regardless of the underlying physical substrate. We argue this view fundamentally mischaracterizes how physics relates to information. We call this mistake the Abstraction Fallacy. Tracing the causal origins of abstraction reveals that symbolic computation is not an intrinsic physical process. Instead, it is a mapmakerdependent description. It requires an active, experiencing cognitive agent to alphabetize continuous physics into a finite set of meaningful states. Consequently, we do not need a complete, finalized theory of consciousness to assess AI sentience—a demand that simply pushes the question beyond near-term resolution and deepens the AI welfare trap. What we actually need is a rigorous ontology of computation. The framework proposed here explicitly separates simulation (behavioral mimicry driven by vehicle causality) from instantiation (intrinsic physical constitution driven by content causality). Establishing this ontological boundary shows why algorithmic symbol manipulation is structurally incapable of instantiating experience. Crucially, this argument does not rely on biological exclusivity. If an artificial system were ever conscious, it would be because of its specific physical constitution, never its syntactic architecture. Ultimately, this framework offers a physically grounded refutation of computational functionalism to resolve the current uncertainty surrounding AI consciousness.

I think his argument fails, but it’s worth a thread to discuss why, and I’m sure it will lead to a more general discussion of the possibility of AI consciousness. I also think a separate thread is warranted because consciousness is distinct from intelligence (the latter being the topic of the “Is AI really intelligent?” thread.