Excavating a cognitive dinosaur

Keith S. Taber

Filling-in; and digging-out a teaching analogy

I like the reflexive nature of this account – of someone reconstructing an analogy

about how cognition reconstructs coherent wholes from partial, fragmented data

from a partial, fragmented memory representation.

I was reading something about memory function that piqued my interest in an analogy:

"Neisser, using an analogy initially developed by Hebb (1949) to characterize [sic] perception, likened the rememberer to a paleontologist who attempts to reconstruct a dinosaur from fragmentary remains: 'out of a few stored bone chips, we remember a dinosaur'…"

Schacter, 1995, p.10

I was interested enough to look up the original use of this analogy (as I report below).

This links to three things that have separately interested me:

• the nature of memory
• the constructivist account of learning and cognition
• using analogies in teaching and comunicating science

The nature of our memories

I have long been interested in what memory is and how it works – and its role in academic learning (Taber,  2003). In part this perhaps derives from the limits of my own memory – I have been reasonably successful academically, but have never felt I had a good memory (and I seem to get more 'absent minded' all the time). This interest grew as it became clearer to me that our memory experiences seem to be quite different – my late wife Philippa would automatically and effortlessly remember things  in a way that that seemed to me to be a kind of superpower. (She was once genuinely surprised that I could not picture what a family member had been wearing on arriving at a family event years before, whereas I thought I was doing pretty well to even remember I had been there.) Now that neurodiversity is widely recognised, it seems less surprising that we do not all experience memory in the same way.

A lot of people, however, understand memory in terms of a kind of folk-model (that is, a popular everyday account which does not match current scientific understanding) – along the lines that we put information into a memory store, where – unless it gets lost and we forget – we can later access it and so remember what it was that we committed to memory. Despite the ubiquity of that notion, research suggests that is not really how memory functions. We might say that this is a common alternative conception of how memory works.

(Read about 'Memory')

The constructive nature of memory

Schacter was referring back to a tradition that began a century ago when Bartlett carried out a series of studies on memory. Bartlett (1932/1995) would, for example, expose people to a story that was unfamiliar to his study participants, and then later ask them to retell as much of the story as they could remember. As might be expected, some people remembered more details than others.

What perhaps was less predictable at the time was the extent to which people included in their retelling details that had not been part of the original story at all. These people were not deliberately embellishing or knowingly guessing, but reporting, as best they could, what their memory suggested had been part of the original story.

People who habitually exhibit this 'confabulation' to an pathological degree (perhaps remembering totally fantastic things that clearly could not be true) are recognised as having some kind of problem, but it transpires this is just an extreme of something that is normal behavior. Remembering is not the 'pulling something out of storage' that we may experience it as – as actually what we remember is more like a best guess based on insufficient data (but a guess made preconsciously, so it appears in our conscious minds as definitive) than a pristine copy of an original experience. Memory is often more a matter of constructing an account from the materials at hand than simply reading it out from something stored.

Thus the analogy. Here is some wider context for the quote presented above:

"The publication of Neisser's (1967) important monograph on cognitive psychology rekindled interest in Bartlett's ideas about schemas and reconstructive memory. According to Neisser, remembering the past is not a simple matter of reawakening a dormant engram or memory trace; past events are constructed by using preexisting knowledge and [schemata] to piece together whatever fragmentary remains of the initial episode are available in memory. Neisser, using an analogy initially developed by Hebb (1949) to characterize [sic] perception, likened the rememberer to a paleontologist who attempts to reconstruct a dinosaur from fragmentary remains: 'out of a few stored bone chips, we remember a dinosaur' (1967, p.285). In this view, all memories are constructions because they include general knowledge that was not part of a specific event, but is necessary to reconstruct it. The fundamentally constructive nature of memory in turn makes it susceptible to various kinds of distortions and inaccuracies. Not surprisingly, Neisser embraced Bartlett's observations and ideas about the nature of memory."

Schacter, 1995, p.10

These ideas will not seem strange to those who have studied science education, a field which has been strongly influenced by a 'constructivist' perspective on learning. Drawing on learning science research, the constructivist perspective focuses on how each learner has to build up their own knowledge incrementally: it is not possible for a teacher to take some complex technical knowledge and simply transfer it (or copy it) to a learner's mind wholesale.

(Read more about constructivism in education)

Excavating the analogy: what did Hebb actually say?

Hebb is remembered for his work on understanding the brain in terms of neural structures – neurons connected into assemblies through synapses.  His book 'The Organization of Behavior' has been described as "one of the most influential books in Psychology and Neuroscience" (Brown, 2020: 1).

The analogy referred to by Schacter was used by Hebb in describing perception. He discussed studies using a tachistoscope, an instrument for displaying images for very brief periods. This could be used to show an image to a person with an exposure insufficient for them to take in all the details,

"…the pattern is perceived, first, as a familiar one, and then with something missing or something added. The something, also, is familiar; so the total perception is a mélange of the habitual.

The subject's reports [make it] clear that the subject is not only responding to the diagram as a whole; he perceives its parts as separate entities, even though presentation is so brief. Errors are prominent, and such as to show that all the subject really perceives–and then only with rough accuracy–is the slope of a few lines and their direction and distance from one another"

Hebb, 1949: pp.46-47

That is, the cognitive system uses the 'clues' available from the incomplete visual data to build  (in effect) a hypothesis of what was seen, based on correspondences between the data actually available and familiar images that match that limited data. What the person becomes consciously aware of 'seeing' is not actually a direct report from the visual field of the presented image, but a constructed image that is a kind of conjecture of what might have been seen – 'filling-in' missing data with what seems most likely based on past visual experiences.

Cognitive scientist Annette Karmiloff-Smith developed the concept of 'representational redescription' as a way of describing how initially tacit knowledge could eventually become explicit. She suggested that "intra-domain and inter-domain representational relations are the hallmark of a flexible and creative cognitive system" (Karmiloff-Smith,1996: 192). The gist was that the brain is able to re-represent its own internal representations in new forms with different affordances.

An loose analogy might be someone who takes a screenshot when displaying an image from the JPEG photo collection folder on the computer, opens the screenshot as a pdf file, and then adds some textual annotations before exporting the file to a new pdf. The representation of the original image is unchanged in the system, but a new representation has been made of it in a different form, which has then been modified and 'stored' (represented) in a different folder.

Hebb was describing how a representation of visual data at one level in the cognitive system has been represented elsewhere in the system (representational redescription?) at a level where it can be mentipulated by 'filling-in'.

Hebb then goes on to use the analogy:

"A drawing or a report of what is seen tachistoscopically is not unlike a paleontologist's reconstruction of early man from a tooth and a rib. There is a clear effect of earlier experience, filling in gaps in the actual perception, so that the end result is either something familiar or a combination of familiar things–a reconstruction on the basis of experience."

Hebb, 1949: p.47

Teaching analogies

Hebb was writing a book that can be considered as a textbook, so this can be seen as a teaching analogy, although such analogies are also used in communicating science in other contexts.

(Read about Science analogies)

Teaching is about making the unfamiliar familiar, and one way we do that is by saying that 'this unfamiliar thing you need to learn about is a bit like this other thing that you already know about'. Of course, when teaching in this way we need to say in what way there is an analogy, and it may also be important to say in what ways the two things are not alike if we do not want people to map across irrelevant elements (i.e., to develop 'associative' learning impediments).

(Read about Making the unfamiliar familiar)

Hebb is saying that visual perception is often not simply the detection of a coherent and integral image, but is rather a construction produced by building upon the available data to construct a coherent and integral image. In extremis, a good deal may be made of very little scraps of input – akin to a scientist reconstructing a model of a full humanoid body based on a couple of bits of bone or tooth.

There are examples where palaeontologists or anthropologists have indeed suggested such complete forms based on a few fossil fragments as data. This is only possible because of their past experiences of meeting many complete forms, and the parts of which they are made. (And of course, sometimes other scientists completely disagree about their reconstructions!)

An exscientific analogy?

Often in teaching science we use teaching analogies that compare an unfamiliar scientific concept to some familiar everyday phenomenon – perhaps a reaction profile is a bit like a roller-coaster track. Perhaps we could call these adscientific analogies as the meaning is transferred to the scientific concept from the everyday.

Sometimes, however, familiar scientific phenomena or ideas are used as the source – as here. Perhaps these could be called exscientific analogies as the meaning is taken from the science concept and applied elsewhere.

Developing the palaeontology analogy

So, Hebb had originally used the palaeontology analogy in the context of discussing perception. When I looked into how Neisser had used the comparison in his "important monograph on cognitive psychology" I found he had developed the analogy, returning to it at several points in his book.

Do we analyse what we attend to?

Neisser's first reference was also in relation to perception, rather than memory. Neisser argued that before we can attend to part of a scene there must already have been the operation of "preattentive mechanisms, which form segregated objects"  from which we can select what to attend to. These processes might be referred to as analyses:

"…the detailed properties and features that we ordinarily see in an attended figure…arise…only because part of the input was selected for attention and certain operations then performed on it. Neither the object of analysis nor the nature of the analysis is inevitable, and both may vary in different observers and at different times."

Neisser, 1967, p.94

But Neisser was not sure this really was 'analysis', which he understood as drawing on another (what I labelled above) exscientific analogy:

"The very word 'analysis' may not be apt. It suggests an analogy with chemistry: a chemist 'analyses' unknown substances to find out what they 'really' are."

Neisser, 1967, p.94

Rather than refer to analysis, we could draw on  Hebb's palaeontological analogy:

"More appropriate…is Hebb's (1949, p.47) comparison of the perceiver with a paleontologist, who carefully extracts a few fragments of what might be bones from a mass of irrelevant rubble and 'reconstructs' the dinosaur that will eventually stand in the Museum of Natural History. In this sense it is important to think of focal attention as a constructive, synthetic activity rather than as purely analytic. One does not simply examine the input and make a decision; one builds an appropriate visual object."

Neisser, 1967, p.94

Neisser draws upon the analogy repeatedly in developing his account of perception:

"Such emotion-flooded experiences [as 'physiognomic' perception: 'Everyone has perceived such traits as suppressed anger in a face, gaiety in a movement, or peaceful harmony in a picture'] can be thought of as the result of particular kinds of construction. The same fragments of bone that lead one paleontologist to make an accurate model of an unspectacular creature might lead another, perhaps more anxious or more dramatic, to 'reconstruct' a nightmarish monster." (pp.96-97)

"To 'direct attention' to a figure is to attempt a more extensive synthesis of it. Of course, synthesis presupposes some prior analysis, as the paleontologist must have some fragments of bone before he can build his dinosaur…" (p.103)

"Recognition, whether of spelling patterns or words as wholes, must be mediated by relevant features, as meaningless in themselves as the bone chips of the paleontologist." (p.114)

"The process of figural synthesis does not depend only on the features extracted from the input, just as the dinosaur constructed by a paleontologist is not based only on the bone chips he has found. Equally important is the kind of perceptual object the perceiver is prepared to construct. The importance of set and context on the perception of words has been demonstrated in a great many experiments." (pp.115-116)

Neisser, 1967

And as with perception, so memory…

When Neisser discusses memory he uses a kind of double analogy – suggesting that memory is a bit like perception, which (as already established) is a bit like the work of the palaeontologist:

"Perception is constructive, but the input information often plays the largest single role in determining the constructive process. A very similar role, it seems to me, is played by the aggregate of information stored in long-term memory.

This is not to say that the stimuli themselves are copied and stored; far from it. The analogy being offered asserts only that the role which stored information plays in recall is like the role which stimulus information plays in perception….The model of the paleontologist, which was applied to perception and focal attention in Chapter 4, applies also to memory: out of a few stored bone chips, we remember a dinosaur….one does not recall objects or responses simply because traces of them exist in the mind, but after an elaborate process of reconstruction, (which usually makes use of relevant stored information).

What is the information – the bone chips – on which reconstruction is based? The only plausible possibility is that it consists of traces of prior processes of construction. There are no stored copies of finished mental events, like images or sentences, but only traces of earlier constructive activity."

Neisser, 1967, p.285

Fleshing-out the metaphor

Neisser then pushes the analogy one step further, by pointing out that the 'fleshed-out' model of a dinosaur in the museum may be constructed in part based on the fossil fragments of bones, but those fragments themselves do not form part of the construction (the model). The bones are used as referents in building the skeletal framework (literally, the skeleton) around which the model will be built, but the model is made from other materials (wood, steel, fibreglass, whatever) and the fossil fragments themselves will be displayed separately or perhaps filed away in a drawer in the museum archives. (As in the representational redescription model – the original representation is redescribed at another level of the system.)

"The present proposal is, therefore, that we store traces of earlier cognitive acts, not of the products of those acts. The traces are not simply 'revised' or 'reactivated' in recall; instead, the stored fragments are used as information to support a new construction. It is as if the bone fragments used by the paleontologist did not appear in the model he builds at all – as indeed they need not, if it to represent a fully fleshed-out skin-covered dinosaur. The bones can be thought of, somewhat loosely, as remnants of the structure which created and supported the original dinosaur, and thus as sources of information about how to reconstruct it."

Neisser, 1967, pp.285-286

The head palaeontologist?

A final reference to the analogy is used when Neisser addresses the question of the cognitive executive: the notion that somewhere in the cognitive system there is something akin to an overseer who direct operations:

"Who does the turning, the trying, and the erring" Is there a little man in the head, a homonculus, who acts the part of the paleontologist vis-à-vis the dinosaur? p.293

Neisser, 1967, p.293

The homonculus can be pictured as a small person sitting in the brain's control room, for example, viewing the images being projected from the visual input.

It is usually considered this is a flawed model (potentially lading to an infinite regress), a failure to take a systemic view of the cognitive system. It is the system which functions and leads to our conscious experience of perceiving, attending, making decisions, planning, remembering, and so forth. Whilst there are specialist components (modules) including for the coordination of the system, there is not a discrete controller overlaying the system as a whole who is doing the seeing, hearing, thinking, etcetera based on outputs from processing by the system.

Here the homonculus would like an authority that the palaeontologist turned to in order to decide how to build her model: raising the question of how does that expert know, and who would they, in turn, ask?

Why change Hebb's orignal analogy?

Altohugh Neisser refers to the analogy as being that used by Hebb, he modifies it. A tooth and rib become fragments of bone, and the early man becomes a dinosaur. Whether the shift from the reconstruction of an early hominid to the reconstruction of a terrible lizard was a deliberate one (for greater effect? because Neisser thought it would be more familiar to his readers?) or not I do not know. The phrasing suggests that Neisser thought he was applying Hebb's original comparison – so I suspect this is how he recalled the analogy.

Perhaps Neisser had regularly used the analogy in his teaching, in which case it may have become so familiar to him that he did not feel the need to check the original version. That is, perhaps he was correctly remembering how he had previously misremembered the original analogy. That is not fanciful, as memory researchers suggest this is something that is very common. Each time we access a memory the wider representational context becomes modified by engagement with it.

That is, if what is represented (in 'long-term memory'*) is indeed "traces of prior processes of construction…traces of earlier constructive activity" then each time a 'memory' is experienced, by being constructed based on what is represented ('in memory'*), new traces of that process of constructing the memory are left in the system.

It is possible over the years to be very convinced about the accuracy of a distorted memory that has been regularly reinforced. (The extent to which this may in part be the origin of many wars, feuds, and divorces might be a useful focus for research?)

So perhaps Neisser had represented in his long-term memory the analogy of a palaeontologist with a few fossil fragments, and when he sought to access the analogy, perhaps in a classroom presentation, the other elements were filled-in: the 'tooth and rib' became 'a few fragments of what might be bones' and the 'early man' become 'a dinosaur' – details that made sense of the analogy in terms familiar to Neisser.

The account of cognition that Hebb, Neisser and Schater were presenting would suggest that if this had been the case then for Neisser there would be no apparent distinction between the parts of Hebb's analogy that Neisser was remembering accurately, and the parts his preconscious mind had filled-in to construct a coherent analogy. I like the reflexive nature of this account – of someone reconstructing an analogy about how cognition reconstructs coherent wholes from partial, fragmented data – from a partial, fragmented memory representation.

 Sources cited:

• Bartlett, F. C. (1932/1995). Remembering: A study in experimental and social psychology Cambridge: Cambridge University Press.
• Brown, R. E. (2020). Donald O. Hebb and the Organization of Behavior: 17 years in the writing. Molecular Brain, 13(1), 55. doi:10.1186/s13041-020-00567-8
• Hebb, D. O. (1949). The Organisation of Behaviour. A neuropsychological theory. New York: John Wiley & Sons, Inc.
• Karmiloff-Smith, A. (1996). Beyond Modularity: A developmental perspective on cognitive science. Cambridge, Massachusetts: MIT Press.
• Neisser, U. (1967). Cognitive Psychology. New York: Appleton-Century-Crofts.
• Schacter, D. L. (1995). Memory distortion: history and current status. In D. L. Schacter (Ed.), Memory Distortion. How minds, brains, and societies reconstruct the past (pp. 1-43). Cambridge, Massachusetts: Harvard University Press.
• Taber, K. S. (2003) Lost without trace or not brought to mind? – a case study of remembering and forgetting of college science, Chemistry Education: Research and Practice, 4 (3), pp.249-277. [Free access]

* terms like 'in memory' and 'in long-term memory' may bring to mind the folk-notion of memory as somewhere in the brain where things are stored away, whereas it is probably better to think of the brain as a somewhat plastic processing system which is constantly being modified by its own functioning. The memory we experience is simply the outcome of active processing** in part of the system that has previously been modified by earlier mental activity (** active processing which is in turn itself further modifying the system).