RESEARCH NOTESEmergence in Models and Minds · 3

Emergence as a Mirror of the Mind

Do you remember the day you learned to speak?

Not your first word, not “mum” or “dad,” but the moment sounds began to carry meaning into the world.

The question is hard to answer. Someone who can now look back through language cannot simply return to a perspective without it. But the absence of a clear boundary in memory does not mean the brain must have flipped a switch one day.

The previous two essays considered the measurement, mechanisms, and prediction of AI capabilities. Now turn the question around: if a continuously changing system can develop new abilities, might that perspective also illuminate human learning and development?

It is worth asking. Yet “both look like sudden breakthroughs” is a starting point, not evidence of a shared mechanism.

1. The vocabulary explosion: a breakthrough or an acceleration?↗

Children do not acquire words at a uniform rate. A child who says only a handful of words may, before long, seem to be naming everything nearby. The phrase “vocabulary explosion” captures how striking that change can look from outside.

Acceleration, however, is not necessarily a phase transition. Ganger and Brent (2004) compared longitudinal vocabulary data from 38 children. Only five were better described by the model with an inflection point. Their finding challenges a universal, discrete “naming insight,” rather than the observation that vocabulary can grow rapidly.

Sound familiar? The first essay confronted the same distinction: rapid improvement and a sudden change in mechanism require separate explanations. A child's language environment is also more complicated than “no teaching, no feedback, and then the ability appears.”

Reading offers a more specific clue. In a 2018 longitudinal study, Dehaene-Lambertz and colleagues repeatedly scanned ten children before and during reading acquisition. Part of the left ventral visual cortex developed selective responses to written words, in the region commonly called the visual word form area, or VWFA.

This was not a new piece of brain tissue appearing from nowhere. Existing cortex acquired a new functional preference. That is what makes neuronal recycling such a compelling idea: culture invents writing, and learning allows an existing visual system to take it in.

The development of circuit functions in models invites comparison. It does not make the VWFA a human “induction head.” New functional organisation calls for explanation; a similar story does not establish the same mechanism.

2. Did you acquire “mind reading” at four?↗

Consider the classic Sally–Anne test.

Sally leaves a ball in a basket and goes away. While she is gone, Anne moves it into a box. When Sally returns, where will she look first?

For a reader who knows the whole story, the answer is easy: the basket. What matters is not where the ball is, but where Sally believes it is. A small question requires a distinction between reality and another person's belief.

Younger children often answer according to the ball's actual location in explicit false-belief tasks, while performance improves markedly during the preschool years. Wellman, Cross, and Watson's (2001) meta-analysis of 178 studies supports that developmental change and also finds that age and task conditions affect performance.

This is important cognitive development. It is not a universal switch from “no concept of belief at three” to “theory of mind at four.” Nor does it identify a threshold of myelination or synaptic pruning that activates previously dormant brain regions on a particular birthday.

“Mind reading” remains an evocative image: the world begins to accommodate another world that does not match reality. The more precise questions are how children learn to sustain that distinction, and how changes in understanding can be separated from changes in task performance. Those are harder, and more revealing, than assigning everyone a day of awakening.

3. Insight: what happens before the answer appears?↗

Move from childhood to adult cognition. A problem resists every attempt; then, during a walk, a shower, or the approach of sleep, the answer arrives with an almost complete sense of certainty.

This is insight: the “Aha!” moment. The answer seems sudden. Did the thinking begin at that instant too?

Jung-Beeman and colleagues (2004) used compound remote-associate problems: find a word that forms a familiar word or phrase with pine, crab, and sauce. The answer is apple. Some correct solutions were accompanied by reported insight; others were not.

Separate groups took part in fMRI and EEG experiments. The EEG comparison found increased right-temporal gamma activity about 0.3 seconds before the solution button press on insight trials. Earlier alpha changes were interpreted as possibly reducing visual interference. These are neural correlates in a particular task, not a direct reading “0.3 seconds before insight begins,” or an all-or-none brain switch.

The result still adds something to the original question: an answer that suddenly becomes available can follow processing the solver could not readily report. Set beside grokking, it suggests asking what has already been changing before the visible jump. Whether the two depend on the same kind of internal reorganisation requires evidence about their mechanisms, not a shared name for the breakthrough.

4. Critical periods: when does the input arrive?↗

There is another side to acquiring an ability: the timing of environmental input can change what it does.

Hubel and Wiesel's work on monocular visual deprivation in kittens is a classic example. Their 1970 study compared cortical responses after one eye had been closed at different ages. Early deprivation sharply reduced the closed eye's influence on cortical cells. After prolonged deprivation, physiological recovery was limited, although some behavioural vision returned.

That is more specific than a story in which an intact eye simply loses all vision forever. Developmental history can impose lasting constraints. The experiment does not show that adult brains have no plasticity, or that every human ability becomes impossible after a fixed age.

Alongside machine learning, it raises a question about the path taken: not only how large a system is or how much input it receives, but how the order of inputs interacts with its internal state and learning rules. A developmental window is not thereby equivalent to a model's training-loss threshold. Both phenomena depend on conditions; that does not give them the same recipe.

5. Collective intelligence: how does a crowd get closer?↗

Now widen the scale. What happens when several minds form a system?

In “Vox Populi” (1907), Galton analysed a weight-judging competition. The median of 787 valid estimates was 1,207 pounds; the ox's actual dressed weight was 1,198 pounds, a difference of about 0.8%. The target was dressed weight, and these are the median figures, rather than the mean-based version often folded into later retellings.

Individual judgments can be inaccurate while their aggregate comes close. That is interesting enough without assuming that nobody knew the answer, or that the crowd acquired consciousness.

A simple model makes some conditions visible. Let the errors eie_i of nn estimates have common bias bb, variance σ2\sigma^2, and the same pairwise correlation ρ\rho, with 0≤ρ≤10\leq\rho\leq1. For their average eˉ=n−1∑iei\bar e=n^{-1}\sum_i e_i:

vn=Var⁡(eˉ)=σ2n[1+(n−1)ρ],MSE⁡(eˉ)=b2+vn.\begin{gathered} v_n=\operatorname{Var}(\bar e)=\frac{\sigma^2}{n}[1+(n-1)\rho],\\ \operatorname{MSE}(\bar e)=b^2+v_n. \end{gathered}

MSE is mean squared error relative to a fixed true value; finite variances are assumed. This is an idealised model of averaging, not a new fit to Galton's median result.

When ρ=0\rho=0, the variance of the average error falls as the crowd grows. For ρ>0\rho>0, it approaches a floor of ρσ2\rho\sigma^2. Shared bias bb does not disappear either. More judgments can dilute some noise without diluting a shared mistake.

This explains why diversity of judgment matters. It also shows why “independence guarantees accuracy” and “communication destroys wisdom” are too simple. Communication can bring information or increase shared bias. Reliability depends on what is being combined, and how.

The example offers intuition for model ensembles. It does not make people equivalent to attention heads, or converging opinions equivalent to mode collapse. A better collective answer and a collective subject of experience remain different questions.

6. Is consciousness itself emergent?↗

This brings the discussion to its deepest question, and its easiest place to overreach.

Tononi's (2004) information integration theory starts from the differentiation and unity of experience, and connects consciousness to a system's capacity to integrate information. “Integration” has a specific causal and information-theoretic meaning here. It is not simply having many parts, many connections, or complicated behaviour.

“Emergence feeling itself from within” may be a philosophical image, but it is not an accurate statement of the paper's conclusion. Even accepting the theory would not justify inferring experience just because a language model became larger or answered more questions correctly.

I want to pause here. Organising information, solving problems, reporting a feeling, and actually having a feeling are distinctions that a change of vocabulary cannot erase. IIT offers a theoretical answer, rather than a settled conclusion that rules out the alternatives.

AI emergence can indeed lead the discussion beyond ability. The closer it comes to existence itself, the more carefully the argument must distinguish a step supported by evidence from one carried by language.

7. The mirror↗

These examples do not combine into a law under which everything awakens at the same kind of critical point. They separate several changes that can otherwise blur together: faster learning, functional specialisation, developing an understanding of belief, an answer reaching awareness, the constraints of developmental history, and the aggregation of judgments.

AI can still be a mirror. It need not replay the whole history of biological life to let formerly entangled questions be asked separately: how does an ability appear, what has been measured, and what changed inside?

The opening question has changed too. Perhaps there is no recoverable “day I learned to speak,” not because the change was a phase transition, but because the language used to describe the past is itself an outcome of that development.

Like a butterfly looking back at the caterpillar. The image matters not because it supplies an anatomical answer to consciousness, but because it points to a distance: after a transformation, how can the earlier perspective be reconstructed?

This series began with measurement, passed through mechanisms and prediction, and returned to ourselves. Perhaps that movement is part of the value of studying machines: seeing a structure elsewhere, then asking what it actually means in the human world.

The mirror has not supplied the answer. It has made some familiar things into questions again.