Qualia Manifesto

by Ken Mogi (published in 1998)

0. Summary

It is the greatest intellectual challenge for humanity at present to elucidate the first principles behind the fact that there is such a thing as a subjective experience. The hallmark of our subjective experiences is qualia. It is the challenge to find the natural law behind the neural generation of qualia which constitute the percepts in our mind, or to go beyond the metaphor of a “correspondence” between physical and mental processes. This challenge is necessary to go beyond the present paradigm of natural sciences which is based on the so-called objective point of view of description. In order to pin down the origin of qualia, we need to incorporate the subjective point of view in a non-trivial manner.

The clarification of the nature of the way how qualia in our mind are invoked by the physical processes in the brain and how the “subjectivity” structure which supports qualia is originated is an essential step in making compatible the subjective and objective points of view.

The elucidation of the origin of qualia rich subjectivity is important not only as an activity in the natural sciences, but also as a foundation and the ultimate justification of the whole world of the liberal arts. Bridging the gap between the two cultures (C.P.Snow) is made possible only through a clear understanding of the origin of qualia and subjectivity.

Qualia symbolize the essential intellectual challenge for the humanity in the future. The impact of its elucidation will not be limited to the natural sciences. The liberal arts, religion, and the very concept of what a man is will be reassessed from the very foundations.

1. History of the Mind-Brain Problem

The strong AI position held by Marvin Minsky and others was an attempt to simulate some aspects of human intelligence from an objective point of view. It had little to say about the essential problems of the mind, namely the qualia rich subjectivity.

In an effort to fill the gap left by the objective natural sciences, such movements as the “new science” and the “new age” came into the scene. These activities, however, were not particularly keen on taking seriously the consistency with the objective sciences. Even if we are to find new paradigms in search of the theory of mind, the consistency with the objective sciences should be maintained. Theses “alternative movements” tended instead to the over-emphasis of the subjective. These activities did not therefore lead to a real breakthrough in the science of the mind. These activities proved to be a stud.

The concept of information due to Claude Shannon is based on a statistical picture, and as he himself declared in his historic paper, has nothing to do with the semantics of information. Despite this, the Shannonian concept of information has been applied to “understand” the information processing in the brain. For example, it is an experimentally accepted fact that there is a correspondence between certain features of external objects and the spatio-temporal firing pattern of a group of neurons in our brain. This selectivity of neural activities is called “response selectivity” and is an important analytical concept in neuropsychology. However, it is wrong to think that the nature of our qualia rich perception can be explained away by the fact that there are activities of neurons in the brain characterized by certain response selectivities. We should instead start from the “interaction picture” rather than the “statistical picture”.

We cannot elucidate the neural correlates of qualia starting from the concept of response selectivity. We should instead start from Mach’s principle in perception.

Qualia is deeply related to the semantic aspects of information. The Shannonian concept of information has little to do with qualia.

2. Qualia and Subjectivity

In view of the neurophysiological data, it is reasonable to assume that qualia in our mind are caused by the collection of action potentials on the cellular membrane of the neuron in our brain.

“I” feel the qualia in “my” mind. This “I” and “my” structure (subjectivity) is maintained also by the neural firings in my brain. The problems of qualia and subjectivity are deeply related.

Qualia and subjectivity in general cannot be explained away by a simple extension of physicalism. From the point of view of the objective sciences, it is necessary and sufficient to describe the temporal evolution of a system. However, the principle of correspondence of qualia to physical states should be constructed on top of the conventional type of natural laws that describe the temporal evolution of the system. This particular natural law should be of a different character from the conventional ones.

Even if we obtain an ultimate physical theory of everything, it only gives a complete description of the temporal evolution of a physical system;even then the origin of qualia from physical processes such as brain activities would remain unsolved.

Causality plays an essential role when we consider the way the perceptual space-time structure in which qualia are embedded arises from the space-time structure of the neural firing in the brain. In particular, in the Principle of Interaction Simultaneity plays an essential role in the origin of the subjective time.

The “subjectivity” that we discuss here has relatively little to do with the “subjectivity” in the context of the theory of measurement in quantum mechanics. It is our view that the introduction of the concept of subjectivity in quantum mechanics did a tremendous disservice. It confused rather than enriched the arguments.

3. Related Problems

In modern physics, “NOW” has no special meaning in the flow of time. In oder to elucidate the origin of our mind, we need to come up with a structure of the time which designates a special meaning to “Now”

The formulationn of the relativistic space-time by the formalism of Riemanian geometry (Minkowski 1911) is only an intermediate step.

4. Methodology and Conjectures

The trivial attempt to assume a seat for subjectivity in the brain (the homunculus solution) is bound to fail. For example, the Crick and Koch model puts the subjectivity seat in the prefrontal cortex. Of course, saying empirically that this seems to be a necessary correlate of subjectivity is O.K. But that does not solve the most difficult part of the problem.

In considering the neural correlates of qualia rich subjective experiences, the invariance under the transformation of neural activity patterns in space and time is going to be essential.

5. Towards the Fusion of Two Cultures

A solution of the qualia problem is bound to have impact not only for the natural sciences but also for the humanities.

To take the visual art, music, literature seriously is to take qualia seriously. For paintings and music, this sounds like a cliche. Literature is also an art of the qualia, as the semantics is embedded in the intentional qualia.

As the so-called “exact” sciences have been focusing only on the measurable and quantifiable properties of nature, there was no place in the scientific world view for the immensely qualia rich subjective experience which is the ultimate raison d’etre for the arts. This was the essential reason why there was and continued to be a division between the two cultures a la C.P.Snow.

To analyze the sound wave of a violin though the Fourier analysis has nothing to do with our subjective experience of the violin sound qualia. It is meaningless to say that color is nothing but the wavelength of light when our concern is the subjective experience of color.

The development of the digital information technology perhaps had a beneficial effect on the fusion of the two cultures. The digital coding of provides a useful tool for the storing and manipulation of information, but has nothing to do with the richness of subjective experience. Unless we understand the “qualia coding” by the neural activities, we cannot find scientific foundations for the subjective experience.

In general, it is nonsensical to try to explain away the enigma of qualia from the information theoretic or evolution theory points of view.

6. On the Coming New Situation

The sense for the future essential entails a sensitivity for the possibility that the next moment can be something completely different from the previously known.

It is no longer meaningful to cling to the systemacity of religion. Religious feelings and values also consist of qualia, which in turn can be treatedly more or less individually. For example, the qualia associated with the stained glass has nothing in essence to do with Christianity. Even though traditional religion employed the appeal of the qualia as an engine to promote their specific causes, there is no reason to obstinately maintain that systemacity now.

Due to the physical limitation of the human brain, there is a limit to the category of qualia that a human being can experience. Only a ridiculously small subset of all possible qualia is accessible to the human being. This makes us take the possibilities of metaphysics more seriously.

7. Agitation

The concept of qualia is clearly at the heart of the next stage of human intellectual endeavors.

There is no other intellectual challenge more important or pressing than qualia.

The revolution can only be brought about by a combination of a rigorous scientific thinking and a trembling sensitivity.

The qualia thinkers of the world, unite!


See also the update on the original manifesto, and Mogi’s thoughts on the “computational theory of mind“.


Cf. Raising the Table Stakes for Successful Theories of ConsciousnessQualia Computing in TucsonDavid Pearce at the “2016 Science of Consciousness”,  “Schrodinger’s Neurons Conjecture”, and Why I think the Foundational Research Institute should rethink its approach

Connectome-Specific Harmonic Waves on LSD

The harmonics-in-connectome approach to modeling brain activity is a fascinating paradigm. I am privileged to have been at this talk in the 2017 Psychedelic Science conference. I’m extremely happy find out that MAPS already uploaded the talks. Dive in!

Below is a partial transcript of the talk. I figured that I should get it in written form in order to be able to reference it in future articles. Enjoy!

[After a brief introduction about harmonic waves in many different kinds of systems… at 7:04, Selen Atasoy]:

We applied the [principle of harmonic decomposition] to the anatomy of the brain. We made them connectome-specific. So first of all, what do I mean by the human connectome? Today thanks to the recent developments in structural neuroimaging techniques such as diffusion tensor imaging, we can trace the long-distance white matter connections in the brain. These long-distance white matter fibers (as you see in the image) connect distant parts of the brain, distant parts of the cortex. And the set of all of the different connections is called the connectome.

selen_connectome_image

Now, because we know the equation governing these harmonic waves, we can extend this principle to the human brain by simply solving the same equation on the human connectome instead of a metal plate (Chladni plates) or the anatomy of the zebra. And if you do that, we get a set of harmonic patterns, this time emerging in the cortex. And we decided to call these harmonic patterns connectome harmincs. And each of these connectome harmonic patterns are associated with a different frequency. And because they correspond to different frequencies they are all independent, and together they give you a new language, so to speak, to describe neural activity. So in the same way the harmonic patterns are building blocks of these complex patterns we see on animal coats, these connectome harmonics are the building blocks of the complex spatio-temporal patterns of neural activity.

Describing and explaining neural activity by using these connectome harmonics as brain states is really not very different than decomposing a complex musical pieces into its musical notes. It’s simply a new way of representing your data, or a new language to express it.

What is the advantage of using this new language? So why not use the state-of-the-art conventional neurimaging analysis methods? Because these connectome harmonics, by definition are the vibration modes, but applied to the anatomy of the human brain, and if you use them as brain states to express neural activity we can compute certain fundamental principles very easily such as the energy or the power.

The power would be the strength of activation of each of these states in neural activity. So how strongly that particular state contributes to neural activity. And the energy would be a combination of this strength of activation with the intrinsic energy of that particular brain state, and the intrinsic energy comes from the frequency of its vibration (in the analogy of vibration).

So in this study we looked at the power and the energy of these connectome harmonic brain states in order to explore the neural correlates of the LSD experience.

We looked at 12 healthy participants who received either 75µg of LSD (IV) or a placebo, over two sessions. These two sessions were 14 days apart in counter-balanced order. And the fMRI scans consisted of 3 eyes-closed resting states scans, each lasting 7 minutes, in the first and the third scan the participants were simply resting, eyes closed, but in the second scan they were also listening to music. And after each scan, the participants rated the intensity of certain experiences.

activity_power_energy_scans.png

So if you look at, firstly, at the total power and the total energy of each of these scans under LSD and placebo, what we see is that under LSD both the power as well as the energy of brain activity increases significantly.

And if we compute the probability of observing a certain energy value on LSD or placebo, what we see is that the peak of this probability distribution clearly shoots towards high energy values under LSD.

energy_difference

And that peak is even slightly higher in terms of probability when the subjects were listening to music. So if we interpret that peak as, in a way, the characteristic energy of a state, you can see that it shifts towards higher energy under LSD, and that this effect is intensified when listening to music.

And then we asked, which of these brain states, which of these frequencies, were actually contributing to this energy increase. So we partitioned the spectrum of all of these harmonic brain states into different parts and computed the energy of each of these partitions individually. So in total we have around 20,000 brain states. And if you look at the energy differences in LSD and placebo, what we find is that for a very narrow range of low frequencies actually these brain states were decreasing their energy on LSD. But for a very broad range of high frequencies, LSD was inducing an energy increase. So this says that LSD alters brain dynamics in a very frequency-selective manner. And it was causing high frequencies to increase their energy.

So next we looked at whether these changes we are observing in brain activity are correlated with any of the experiences that the participants themselves were having in that moment. If you look at the energy changes within the narrow range of low frequencies, we found that the energy changes in that range significantly correlated with the intensity of the experience of ego dissolution. The loss of subjective self.

ego_dissolution

And very interestingly, the same range of energy change within the same frequency range also significantly correlated with the intensity of emotional arousal, whether the experience was positive or negative. This could be quite relevant for studies looking into potential therapeutic applications of LSD.

emotional_arousal

Next, when we look at a slightly higher range of frequencies, what we found was that the energy changes within that range significantly correlated with the positive mood.

higher_frequencies

In brief, this suggests that it’s rather the low frequency brain states which correlated with ego dissolution or with emotional arousal, and it’s the activity of higher frequencies that is correlated with the positive experiences.

Next, we wanted to check the size of the repertoire of active brain states. And if you look at the probability of activation for any brain state (so we are not distinguishing for any frequency brain states), what we observe is that the probability of a brain state being silent (zero contribution), actually decreased under LSD. And the probability of a brain state contributing very strongly, which corresponds to the tails of these distributions, were increased under LSD. So this suggests that LSD was activating more brain states simultaneously.

repertoaire

And if we go back to the music analogy that we used in the beginning, that would correspond to playing more musical notes at the same time. And it’s very interesting, because studies that have looked at improvising, those who have looked at jazz improvisation, show that improvising jazz musicians play significantly more musical notes compared to memorized play. And this is what we seem to be finding under the effect of LSD. That your brain is actually activating more of these brain states simultaneously.

cross-frequency

And it does so in a very non-random fashion. So if you look at the correlation across different frequencies. Like at the co-activation patterns, and their activation over time. You may interpret it as the “communication across various frequencies”. What we found is that for a very broad range of the spectrum, there was a higher correlation across different frequencies in their activation patterns under LSD compared to placebo.

So this really says that LSD is actually causing a reorganization, rather than a random activation of brain states. It’s expanding the repertoire of active brain states, while maintaining -or maybe better said- recreating a complex but spontaneous order. And in the musical analogy it’s really very similar to jazz improvisation, to think about it in an intuitive way.

Now, there is actually one particular situation when dynamical systems such as the brain, and systems that change their activity over time, show this type of emergence of complex order, or enhanced improvisation, enhanced repertoire of active states. And this is when they approach what is called criticality. Now, criticality is this special type of behavior, special type of dynamics, that emerges right at the transition between order and chaos. When these two (extreme) types of dynamics are in balance. And criticality is said to be “the constantly shifting battle zone between stagnation and anarchy. The one place where a complex system can be spontaneous, adaptive, and alive” (Waldrop 1992). So if a system is approaching criticality, there are very characteristic signatures that you would observed in the data, in the relationships that you plot in your data.

And one of them is -and probably the most characteristic of them- is the emergence of power laws. So what does that mean? If you plot one observable in our data, which for example, in our case would be the maximum power of a brain state, in relationship to another observable, for example, the wavenumber, or the frequency of that brain state, and you plot them in logarithmic coordinates, that would mean that if they follow power laws, they would approximate a line. And this is exactly what we observe in our data, and surprisingly for both LSD as well as for placebo, but with one very significant and remarkable difference: because the high frequencies increase their power on LSD, this distribution follows this power law, this line, way more accurately under LSD compared to placebo. And here you see the error of the fit, which is decreasing.

This suggests that LSD shoots brain dynamics further towards criticality.  The signature of criticality that we find in LSD and in placebo is way more enhanced, way more pronounced, under the effect of LSD. And we found the same effect, not only for the maximum power, but also for the mean power, as well as for the power of fluctuations.

criticality_signature

So this suggests that the criticality actually may be the principle that is underlying this emergence of complex order, and this reorganization of brain dynamics, and which leads to enhanced improvisation in brain activity.

So, to summarize briefly, what we found was that LSD increases the total power as well as total energy of brain activity. It selectively activates high frequency brain states, and it expands the repertoire or active brain states in a very non-random fashion. And the principle underlying all of these changes seems to be a reorganization of brain dynamics, right at criticality, right at the edge of chaos, or just as the balance between order and chaos. And very interestingly, the “edge of chaos”, or the edge of criticality, is said to be where “life has enough stability to sustain itself, and enough creativity to deserve the name of life” (Waldrop 1992). So I leave you with that, and thank you for your attention.

[Applauses; ends at 22:00, followed by Q&A]

Qualia Computing at Consciousness Hacking (June 7th 2017)

I am delighted to announce that I will be presenting at Consciousness Hacking in San Francisco on 2017/6/7 (YMD notation).

Consciousness Hacking (CoHack) is an extremely awesome community that blends a genuine interest in benevolence, scientific rationality, experiential spirituality, self-experimentation, and holistic wellbeing together with an unceasing focus on consciousness. Truth be told, CohHack is one of the reasons why I love living in the Bay Area.

Here are the relevant event links: Eventbrite, FacebookMeetup.

And the event description:


What would happen if a bliss technology capable of inducing a constant MDMA-like state of consciousness with no negative side effects were available? What makes an experience good or bad? Is happiness a spiritual trick, or is spirituality a happiness trick?

At this month’s speaker presentation, Consciousness Hacking invites Data Science Engineer, Andrés Gómez Emilsson to discuss current research, including his own, concerning the measurement of bliss, how blissful brain states can be induced, and what implications this may have on quality of life and our relationship with the world around us.

Emilsson’s research aims to create a mathematical theory of the pleasure-pain axis that can take information about a person’s brain at a given point in time and return the approximate (or even true) level of happiness and suffering for that person. Emilsson will explore two dimensions that have been studied in affective neuroscience for decades:

  • Arousal: how much energy and activation a given emotion has
  • Valence: the “feel good or feel bad” dimension of emotion

If the purpose of life is to feel happy and to make others happy, then figuring out how valence is implemented in the brain may take us a long way in that direction. Current approaches to valence, while helpful, usually don’t address the core of the problem (ie. usually just measuring the symptoms of pleasure such as the neurotransmitters that trigger it, brain regions, positive reinforcement, etc. rather than getting at the experience of pleasure itself).

A real science of valence would not only be able to integrate and explain why the things people report as pleasurable are pleasant, it would also make a precise, empirically falsifiable hypothesis about whether arbitrary brain states will feel good or bad. This is what Emilsson aims to do.

You will take away:

  • An understanding about the current scientific consensus on the nature of happiness in the brain, and why it is incomplete
  • A philosophical case for both the feasibility and desirability of a world devoid of intense suffering
  • A new candidate mathematical formula that can be used to predict the psychological wellbeing of a brain at a given point in time
  • An argument for why bliss technology that puts us in a constant MDMA-like state of consciousness with no negative side effects is likely to become available within the next two to five decades
  • The opportunity to network with other people who are serious about figuring out the meaning of life through introspection and neuroscience

About our speaker:

Andrés Gómez Emilsson was born in México City in 1990. From an early age, he developed an interest in philosophy, mathematics, and science, leading him to compete nationally and internationally in Math and Science Olympiads. At 16, his main interest was mathematics, but after an unexpected “mystical experience”, he turned his attention to consciousness and the philosophical problems that it poses. He studied Symbolic Systems with an Artificial Intelligence concentration at Stanford, and later finished a masters in Computational Psychology at the same university. During his time at Stanford he co-founded the Stanford Transhumanist Association and became good friends with transhumanist philosopher David Pearce, taking on the flag of the Hedonistic Imperative (HI). In order to pursue the long-term goals of HI, his current primary intellectual interest is to reverse-engineer the functional, biochemical and/or quantum signatures of pure bliss.

He is currently working at a Natural Language Processing company in San Francisco, creating quantitative measures of employee happiness, productivity, and ethics at companies, with the long-term intent of creating a consciousness research institute that’s also a great place to work for (i.e. one in which employees are happy, productive, and ethical). In his free time he develops psychophysical tools to study the computational properties of consciousness.

Schedule:

6:30: Check in, snacks

6:45: Structured schmoozing

6:55: Event intro and meditation

7:00: Andrés Gómez Emilsson

7:50: Break

8:00: Break-out Sessions (small group discussion)

9:00: Break-out Recap

9:15: Closing meditation

About our venue:

ECO-SYSTM is a dynamic community of creative professionals, startups, and freelancers, founded on the idea that entertainment, creativity and business can come together to offer a truly unique work experience for Bay Area professionals. Check out membership plans here: http://eco-systm.com/


 

Core Philosophy

David Pearce asked me ages ago to make accesible videos about transhumanism, consciousness and the abolitionist project. Well, here is a start

In this video I outline the core philosophy and objectives of Qualia Computing. There are three main goals here:

 

  1. Catalogue the entire state-space of consciousness
  2. Identify the computational properties of each experience (and its qualia components), and
  3. Reverse engineer valence (i.e. to discover the function that maps formal descriptions of states of consciousness to values in the pleasure-pain axis)

 

While describing the 1st objective I explain that we start by realizing that consciousness is doing something useful (or evolution would not have been able to recruit it for information-processing purposes). I also go on to explain the difference between qualia varieties (e.g. phenomenal color, smell, touch, thought, etc.) and qualia values (i.e. the specific points in the state-spaces defined by the varieties, such as “pure phenomenal blue” or the smell of cardamom).

 

With regards to the 2nd objective, I explain that our minds actually use the specific properties of each qualia variety in order to represent information states and then to solve computational problems. We are only getting started in this project.

 

And 3rd, I argue that discovering exactly what makes an experience “worth living” in a formal and mathematical way is indeed ethically urgent. With a fundamental understanding of valence we can develop precise interventions to reduce (even prevent altogether) any form of suffering without messing up with our capacity to think and explore the state-space of consciousness (at least the valuable part of it).

 

I conclude by pointing out that the 1st and 2nd research programs actually interact in non-trivial ways: There is a synergy between them which may lead us to a recursively self-improving intelligence (and do so in a far “safer” way than trying to build an AGI through digital software).