Evolution does not select for veridical perception

The title is from a blog post by Brian Leiter. Leiter links to an article in the LA Review of books: Imitation and Extinction: The Case Against Reality. The article is written by Donald Hoffman.

We have discussed the general topic before, in several threads. So maybe this is a good time to revisit the topic.

Hoffman asks: “I see a green pear. Does the shape and color that I experience match the true shape and color of the real pear?”

My take is that there is no such thing as the “true shape and color of the pear.”

It is a common presumption, that there is an external standard of truth. Here, I mean “external to humans”. Truth is presumed to come from somewhere else. And our perceptual systems evolved to present us with what is true.

As I see it, this is backwards. Yes, our perceptions are mostly true. But this is not because perception is based on truth. Rather, it is because our human ideas of truth are based on what we perceive.

Open for discussion.

424 thoughts on “Evolution does not select for veridical perception

  1. Corneel: . Ants and birds don’t label your chair the way humans do (which we can agree on is an abstraction). But they still recognise it as a solid object distinct from its surroundings

    That you and Neil can’t agree on this matter was predicted in Wittgenstein’s Tractatus. On his view there can’t be an answer to this question because it can’t be coherently asked.

  2. I would agree that terms like object, solid, real, bird, rock, etc are useful terms, in that we use them successfully.

    But then our vocabularies are full of obsolete words that were once useful.

    Physics is the most philosophical of the sciences, and in my lifetime the trend has been toward simplification, or at least a reduction in the number of kinds.

  3. CharlieM,

    If we see the rays of the sun spreading out towards the earth from behind a cloud, they make various angles the apex of which originates in the sun. Some would say that this is a perceptual illusion as the streams of light are in actual fact virtually parallel to each other. But, because the retina is a two dimensional surface, the patterns of light falling on it do in reality possess the angles as we see them.

    Illusions aren’t all like that. Here’s one where the perception itself is clearly non-veridical. Those contours aren’t really there, either in reality or in the retinal image:

  4. keiths: Those contours aren’t really there, either in reality or in the retinal image:

    Maybe.

    Before Lettvin’s frog studies, the retina was viewed as a receptor of light that merely sent signals to the brain for interpretation. “The assumption has always been that the eye mainly senses light, whose local distribution is transmitted to the brain in a kind of copy by a mosaic of impulses,” he wrote. Instead of accepting that assumption, he attached electrodes to the frog’s optic nerve so he could eavesdrop on the signals it sent. He then positioned an aluminum hemisphere around the frog’s eye and moved objects attached to small magnets along the inner surface of the sphere by moving a large magnet on its outer side.

    By analyzing the signals the optic nerve produced when viewing the objects, ­Lettvin and his collaborators demonstrated the concept of “feature detectors”—neurons that respond to specific features of a visual stimulus, such as edges, movement, and changes in light levels. They even identified what they called “bug detectors,” or cells in a frog’s retina that are predisposed to respond when small, dark objects enter the visual field, stop, and then move intermittently. In short, Lettvin’s group discovered that a lot of what was thought to happen in the brain actually happened in the eye itself.

    https://www.technologyreview.com/s/508376/in-a-frogs-eye/

    There are color illusions in humans that originate in the retina.

  5. I seem to have a lizard detector. Even when I had uncorrected cataracts, I could spot an anole move fifty feet away, while embedded in shrubbery. I assume there is some evolutionary advantage to such an ability.

    I suspect much of our object detection is preconscious.

  6. Bruce,

    I think that perception is not just bottom up; it is top down as well.

    I agree, but it remains true that information flows from external reality to us.

    Because of that, I don’t think it is correct to say information flows from the environment. Rather, information from perception is something that depends on the processing an organism does based on its internal state and using both data sensed in the environment and acting in that environment.

    Something is being carried by the photons in Neil’s cat scenario. That something reduces the uncertainty of the receiver. If it does so, why balk at calling it information?

  7. petrushka,

    By the ‘retinal image’, I mean the image that is projected onto the retina by the lens. The contours are absent in that image.

  8. Neil,

    Conventions are arbitrary in the sense that different choices could have been made. But they are not random. They are guided by pragmatic considerations.

    And that guidance constitutes feedback from the environment. Reality calls the shots.

    No matter how many people agree that rocks are food, they aren’t food in reality. Truth is not merely conventional.

  9. petrushka,

    Thanks for that very informative essay about Lettvin et al!

    It’s a remarkable paper and it was influential on the cognitive science and philosophy of its time. The other co-authors of that paper have their own interesting stories. Humberto Maturana, a Chilean biologist, went on to develop second-order cybernetics and collaborated with Francisco Varela on autopoiesis. McCulloch and Pitts were among the founders of cybernetics and (among many other things) invented computational neuroscience in their 1943 paper.

  10. keiths: By the ‘retinal image’, I mean the image that is projected onto the retina by the lens. The contours are absent in that image.

    So what other pre-conscious processing might be happening?

    I’ve said this before, but I see no conceptual difference between learning that is the result of biological evolution and learning that occurs in individuals as a result of interaction with the environment. Our perception of named objects is learned.

    One can argue that real things are out there, but the way we perceive them and manipulate them and talk about them is learned.

    It may not be the only way of perceiving. How, for example, might a person view reality if raised with VR goggles that supported magical manipulations of objects?

  11. Neil Rickert: Yes, ants climb over it, just as they would if they did not see it as distinct from surroundings. And a similar comment applies to birds.

    If ants don’t view chairs as distinct from their surroundings, why would they be attempting to climb them? If you need another example: wasps will be chewing the wood from your chair, so they are capable of distinguishing the material your chair is made of from e.g, the tiles underneath it. And do you really believe that birds are capable of landing on chairs without seeing them as distinct from surroundings? Huh!

    Neil Rickert: I have no way of knowing whether ants and birds see it as distinct from their surroundings. And I suspect the same limitations apply to you.

    So how did you get from “If there is an external truth (external to humans), then it should be the same for all organisms” to “I have no way of knowing and neither do you”? If we can learn that animals don’t think of chairs as chairs than why can’t we all of sudden learn anything else?

  12. walto: That you and Neil can’t agree on this matter was predicted in Wittgenstein’s Tractatus. On his view there can’t be an answer to this question because it can’t be coherently asked.

    I certainly noticed that I have to work very hard to get my point across, but why can’t this question be coherently asked according to Wittgenstein?

  13. Alan Fox,

    This?

    Most propositions and questions, that have been written about philosophical matters, are not false, but senseless. We can-not, therefore, answer questions of this kind at all, but only state their senselessness. Most questions and propositions of the philosophers result from the fact that we do not understand the logic of our language. (They are of the same kind as the question whether the Good is more or less identical than the Beautiful.) And so it is not to be wondered at that the deepest problems are really no problems.

    Should I worry if this does not provide me with deep insights?

  14. keiths: Something is being carried by the photons in Neil’s cat scenario. That something reduces the uncertainty of the receiver. If it does so, why balk at calling it information?

    Because it only becomes information because of the processing by the receiver, which was Neil’s point all along. So it is not information, but magma.

  15. Corneel: Should I worry if this does not provide me with deep insights

    In Trac, Witt advanced a theory of language, the world, and of how the two interacted. Based on that, he concluded that some things could only be shown, not said and that attempts to use language to discuss such things only produced nonsense. Among the things that could only be shown was a lot of philosophy. Which meant Trac was nonsense, which Witt readily admitted. But if one saw that, then the Trac had served its purpose.

    With Ramsay’s help, Witt realized his theory of language in Trac was wrong. He started over again.

    Some consider Witt to be the Steiner of the 20th century. But that is likely going too far.

    https://www.sparknotes.com/philosophy/wittgenstein/

    Historical tidbit: Witt invented truth tables.

  16. BruceS: Among the things that could only be shown was a lot of philosophy. Which meant Trac was nonsense, which Witt readily admitted. But if one saw that, then the Trac had served its purpose.

    Heh, that’s lovely. I missed how self-referential that proposition was.

    I think I also see now what Walto was getting at. Thanks.

  17. keiths: If it does so, why balk at calling it information?

    Because attributing information solely to the environment does not capture the meaning of the word as it is used in science or philosophy.

    I have not checked the dictionary because I don’t consider that relevant.

  18. Corneel: I think I also see now what Walto was getting at

    Walto is not always serious lately at TSZ, but when it comes to Trac and Spinoza, he usually is. Usually….

  19. Corneel:

    Because it only becomes information because of the processing by the receiver, which was Neil’s point all along. So it is not information, but magma.

    Heh. That’s exactly what it feels like.

  20. keiths:

    Something is being carried by the photons in Neil’s cat scenario. That something reduces the uncertainty of the receiver. If it does so, why balk at calling it information?

    Bruce:

    Because attributing information solely to the environment does not capture the meaning of the word as it is used in science or philosophy.

    Who said anything about ‘solely’? I’ve never restricted information to the environment alone.

  21. Corneel: Should I worry if this does not provide me with deep insights?

    Not really, no. But for a bit more context: in Tractatus Wittgenstein is arguing that a statement is meaningful or has a sense only if it conforms to logical principles and ‘points to’ (“pictures”) a fact (an actual state of affairs). The propositions of ethics, metaphysics, and aesthetics don’t do this, so they don’t really have a sense. The TLP was very influential on the logical positivists, though the respect was one-sided. When the Vienna Circle invited him to one of their meetings, Wittgenstein read the poetry of Rabindranath Tagore.

    BruceS: In Trac, Witt advanced a theory of language, the world, and of how the two interacted. Based on that, he concluded that some things could only be shown, not said and that attempts to use language to discuss such things only produced nonsense. Among the things that could only be shown was a lot of philosophy. Which meant Trac was nonsense, which Witt readily admitted. But if one saw that, then the Trac had served its purpose.

    With Ramsay’s help, Witt realized his theory of language in Trac was wrong. He started over again.

    Though I would add that Sellars’s own contribution here is to show how cybernetics can be used to rescue picturing from Wittgenstein’s own pragmatist critique of his earlier self — by taking picturing, not as a theory of linguistic meaning, but as a theory of information processing.

  22. Kantian Naturalist:

    Though I would add that Sellars’s own contribution here i

    Sellars text is also mystifying to the uninitiated, like me. So they have that in common too.

    Thanks for the detail in the rest of your post.

  23. keiths:
    CharlieM,

    Illusions aren’t all like that.Here’s one where the perception itself is clearly non-veridical.Those contours aren’t really there, either in reality or in the retinal image:

    But they are there in the concept triangle. Reality is the concept/sense percept as a whole. I am not saying it is the concept plus the percept, rather it is we who have taken the reality and divided it this way into percept and concept

    There are no perceptions that give us full reality. All of them are incomplete. We only get reality when our perceptions are combined with the appropriate concepts. By adding concepts and percepts in this way we are restoring a reality that has always existed. It is we ourselves because of the way we are constituted that have separated reality into these two domains.

    Our sense perception gives us an incomplete image of two equilateral triangles, but as it is in our nature to try to restore wholeness to the separate images of our senses we can actually see these triangles. And here I mean seeing as in the unity of concept/percept. We need to come to an understanding of the whole, but we need to do it in the right way.

    In the book Goethe’s Way of Science: A Phenomenology of Nature edited by David Seamon, Arthur Zajonc, Henri Bortoft writes on page 286:

    Awareness is occupied with things. The whole is absent to awareness because it is not a thing among things. To awareness the whole is no-thing, and since awareness is awareness of something, no-thing is nothing. The whole that is no-thing is taken as mere nothing, in which case it vanishes. When this loss happens, we are left with a world of things, and the apparent task of putting them together to make a whole. Such an effort disregards the authentic whole.

    The other choice is to take the whole to be no-thing but not nothing. This possibility is difficult for awareness, which cannot distinguish the two. Yet, we have an illustration immediately on hand with the experience of reading. We do not take the meaning of a sentence to be a word. The meaning of a sentence is no-word. But evidently this is not the same as nothing, for if it were we could never read! The whole presences within parts, but from the standpoint of awareness that grasps the external parts, the whole is an absence. This absence, however, is not the same as nothing. Rather, it is an active absence inasmuch as we do not try to be aware of the whole, as if we could grasp it like a part, but instead let ourselves be open to be moved by the whole.

    We do not have the right understanding of the whole if we imagine it to be a thing among things.

    I know that in reality there can never be such physical thing as a triangle or a straight line or a point, so all pure sense perceptions are in that sense illusions. But they are only illusions for our expectations. The illusion you provided gives us approximations of triangles just like any other physical triangle we look at.

  24. petrushka: I suspect much of our object detection is preconscious.

    Of course it is. You should try a spell as a passenger in a car I’m driving.

  25. The main point of the Tractatus as I understand it is that the propositions like those Corneel and Neil are trying to make here can’t be made in an “ideal language”–i.e., a language in which there are no self-referential messes made. In such a language, first-order statements (object languages) can only refer to the world, first-order metalanguages can only refer to statements in an object language, second order metalanguages can only refer to statements in first order metalanguages, etc. During that period of Witt’s work (and perhaps throughout his life–that’s controversial), he–and his positivist followers–believed that, in common with the paradoxes Russell talked about, the only solution to intractable philosophical problems is a coherent theory of types. The thing is, metaphysical statements (like those that Neil and Corneel have been making) can’t be put in an ideal language. So they’re windy mysticism, unlike the self-admitted mysticism in Witt’s book, which is not windy. Think about it–how are you going to talk about whether/how your talk is categorizing reality without getting into use-mention difficulties?

    I discuss this (to me, fascinating) matter in detail in a paper called “Metaphysical Realism and the Various Cognitive Predicaments of Everett W. Hall.” That’s in a (widely unread classic) book of mine called “The Roots of Representationism: An Introduction to Everett Hall.” It’s available on Amazon, but, sadly, it costs more than anybody is (and probably should be) willing to pay for the no doubt limited value of its contents.

    Alas.

  26. Kantian Naturalist: When the Vienna Circle invited him to one of their meetings, Wittgenstein read the poetry of Rabindranath Tagore.

    I like his style!

    Thanks for the detailed explanation.

  27. walto,

    LOL. That’s the first time in my life I am being accused of “windy mysticism”.

    I am self aware enough to recognize that I am abysmal at philosophy and that you are probably right. But I don’t quite understand yet what made you say that.

    walto: Think about it–how are you going to talk about whether/how your talk is categorizing reality without getting into use-mention difficulties?

    So you are saying that I cannot phrase my arguments about the true structure of the world in a way that doesn’t use some sort of categorisation on my part, correct?

  28. walto:
    The main point of the Tractatus

    Thanks, Walt, very helpful.

    Those ideas of Wittgenstein are used in the Beni 2018 book I am reading to justify why some existing structural approaches to scientific realism cannot claim that their mathematical structures succeed in representing reality. Namely, because they are cannot speak about themselves in the structural formalisms they use. Or at least that is what I think he is saying.

    Somewhat like KN is updating Sellars, Beni is going to rely on structures which grounded in perception which we can take as latching onto reality because of evolution. I think his last chapter will deal with Hoffman’s issues.

    On my post to Corneel: I see my troll comparing Witt and Steiner failed to hook you. Of course, I just made that bit up.

  29. Corneel: If ants don’t view chairs as distinct from their surroundings, why would they be attempting to climb them?

    This does not make sense. Ants crawl over everything. Presumably, they are exploring for food.

    If you need another example: wasps will be chewing the wood from your chair, so they are capable of distinguishing the material your chair is made of from e.g, the tiles underneath it.

    I would take that as evidence that they do not see the chair as a separate object. They see the wood as the same kind of substance that they find elsewhere.

    So how did you get from “If there is an external truth (external to humans), then it should be the same for all organisms” to “I have no way of knowing and neither do you”? If we can learn that animals don’t think of chairs as chairs than why can’t we all of sudden learn anything else?

    I am having trouble making sense of that.

    We can only judge animal knowledge by their behavior. And sometimes their behavior is not sufficient evidence for us to answer the questions that we ask. “Distinct from their surroundings” makes sense to us as humans, but it might not make sense to other animals.

  30. Corneel:
    walto,

    LOL. That’s the first time in my life I am being accused of “windy mysticism”.

    I am self aware enough to recognize that I am abysmal at philosophy and that you are probably right. But I don’t quite understand yet what made you say that.

    So you are saying that I cannot phrase my arguments about the true structure of the world in a way that doesn’t use some sort of categorisation on my part, correct?

    Oh, no insult intended, Corneel. The greatest and most brilliant philosophers who ever lived have just been uttering arrant nonsense according to Wittgenstein.

    On that view we can say “This is red.” But when we try to get philosophical about what’s going on when we do so, we start violating the ideal language rules that positivists sought.

    But don’t despair, very few people agree with that viewpoint these days.

  31. BruceS: I see my troll comparing Witt and Steiner failed to hook you.

    Yeah, I didn’t like that.

    The Beni book looks interesting. Too much political philosophy to read, though.

  32. Neil Rickert: I would take that as evidence that they do not see the chair as a separate object. They see the wood as the same kind of substance that they find elsewhere.

    Just a pedantic point: ants rely much more on scent, touch and dead reckoning than they do on vision. Ant nests are generally underground.

  33. walto: The thing is, metaphysical statements (like those that Neil and Corneel have been making) can’t be put in an ideal language.

    Not their fault. It’s not possible for any sentient entity to understand itself. The cognitive capacity that evolves due to niche/population pressure is sufficient for sentient beings to be themselves but there is not additional capacity to understand (in the sense of deconstruct/reconstruct) themselves. (I may have made this point before.)

  34. Neil Rickert: We can only judge animal knowledge by their behavior. And sometimes their behavior is not sufficient evidence for us to answer the questions that we ask. “Distinct from their surroundings” makes sense to us as humans, but it might not make sense to other animals.

    That’s where neuroscientists should be looking for understanding – simpler animals.

  35. walto: Yeah, I didn’t like that.

    The Beni book looks interesting. Too much political philosophy to read, though.

    Sorry if the Steiner stuff pissed you off. It was no doubt yet another of my ill-conceived attempts at humour. The least I could have done was to throw in some of them emoji thingamabobs.

    I don’t know if the Beni book would interest you, even if you had time for it. It’s mostly about philosophy of science combined the Predictive Processing approach to perception which it combines in a novel and weird way. I think it throws in some of the enactive stuff as well near the end of the book. The Wittgenstein reference is only a small part.

  36. Neil Rickert: We can only judge animal knowledge by their behavior

    Do flies see a chair as a [chair]? Obviously not in the sense that humans can deploy sophisticated, language-based concepts as part of perception. But if we allow an animal version of a concept by basking it on its behaviour, perhaps we can say that flies see chairs as [landing spots]. As do we, based solely on our body behavior. In fact, our language concept is based in the body behavior.

    So there is a family resemblance between our body concept of a chair and the flies version, using “family resemblance” in Wittgenstein’s sense (post Trac).

    Not there there is that much overall resemblance between us and flies. Except maybe for some weird possibilities that a Canadian did the best job of considering.

  37. keiths:

    Illusions aren’t all like that.Here’s one where the perception itself is clearly non-veridical.Those contours aren’t really there, either in reality or in the retinal image:

    CharlieM:

    But they are there in the concept triangle.

    Right. So the perceptual apparatus itself is responsible for the illusion — creating contours that aren’t really there — which in turn causes us to invoke the concept of ‘triangle’ where there is none.

  38. keiths: So the perceptual apparatus itself is responsible for the illusion — creating contours that aren’t really there — which in turn causes us to invoke the concept of ‘triangle’ where there is none.

    Not sure about that. Evolutionary processes honed our sensorimotor system. Making decisions on scant evidence can be life-saving.

  39. BruceS: Do flies see a chair as a [chair]? Obviously not in the sense that humans can deploy sophisticated, language-based concepts as part of perception.

    You could be overinflating human cognition, here. Easy to fall into the trap of “obviously”.

  40. Corneel:

    If you need another example: wasps will be chewing the wood from your chair, so they are capable of distinguishing the material your chair is made of from e.g, the tiles underneath it.

    Neil:

    I would take that as evidence that they do not see the chair as a separate object. They see the wood as the same kind of substance that they find elsewhere.

    They distinguish the wood from the tiles, and they chew on the former but not the latter. Where the wood is in reality governs where the wasps go to chew on it. It’s an external truth.

  41. BruceS: But if we allow an animal version of a concept by basking it on its behaviour, perhaps we can say that flies see chairs as [landing spots].

    Flies see everything as landing spots (including my nose).

  42. Alan,

    Not sure about that. Evolutionary processes honed our sensorimotor system. Making decisions on scant evidence can be life-saving.

    I agree with that, but I don’t see where it contradicts what I wrote:

    So the perceptual apparatus itself is responsible for the illusion — creating contours that aren’t really there — which in turn causes us to invoke the concept of ‘triangle’ where there is none.

Leave a Reply