“Everyone takes the limits of his own vision for the limits of the world.” (Schopenhauer)
All that matters is the pleasure-pain axis. Pain and pleasure disclose the world’s inbuilt metric of (dis)value. Our overriding ethical obligation is to minimise suffering. After we have reprogrammed the biosphere to wipe out experience below “hedonic zero”, we should build a “triple S” civilisation based on gradients of superhuman bliss. The nature of ultimate reality baffles me. But intelligent moral agents will need to understand the multiverse if we are to grasp the nature and scope of our wider cosmological responsibilities. My working assumption is non-materialist physicalism. Formally, the world is completely described by the equation(s) of physics, presumably a relativistic analogue of the universal Schrödinger equation. Tentatively, I’m a wavefunction monist who believes we are patterns of qualia in a high-dimensional complex Hilbert space. Experience discloses the intrinsic nature of the physical: the “fire” in the equations. The solutions to the equations of QFT or its generalisation yield the values of qualia. What makes biological minds distinctive, in my view, isn’t subjective experience per se, but rather non-psychotic binding. Phenomenal binding is what consciousness is evolutionarily “for”. Without the superposition principle of QM, our minds wouldn’t be able to simulate fitness-relevant patterns in the local environment. When awake, we are quantum minds running subjectively classical world-simulations. I am an inferential realist about perception. Metaphysically, I explore a zero ontology: the total information content of reality must be zero on pain of a miraculous creation of information ex nihilo. Epistemologically, I incline to a radical scepticism that would be sterile to articulate. Alas, the history of philosophy twinned with the principle of mediocrity suggests I burble as much nonsense as everyone else.
The harmonics-in-connectome approach to modeling brain activity is a fascinating paradigm. I am privileged to have been at this talk in the 2017 Psychedelic Science conference. I’m extremely happy find out that MAPS already uploaded the talks. Dive in!
Below is a partial transcript of the talk. I figured that I should get it in written form in order to be able to reference it in future articles. Enjoy!
[After a brief introduction about harmonic waves in many different kinds of systems… at 7:04, Selen Atasoy]:
We applied the [principle of harmonic decomposition] to the anatomy of the brain. We made them connectome-specific. So first of all, what do I mean by the human connectome? Today thanks to the recent developments in structural neuroimaging techniques such as diffusion tensor imaging, we can trace the long-distance white matter connections in the brain. These long-distance white matter fibers (as you see in the image) connect distant parts of the brain, distant parts of the cortex. And the set of all of the different connections is called the connectome.
Now, because we know the equation governing these harmonic waves, we can extend this principle to the human brain by simply solving the same equation on the human connectome instead of a metal plate (Chladni plates) or the anatomy of the zebra. And if you do that, we get a set of harmonic patterns, this time emerging in the cortex. And we decided to call these harmonic patterns connectome harmincs. And each of these connectome harmonic patterns are associated with a different frequency. And because they correspond to different frequencies they are all independent, and together they give you a new language, so to speak, to describe neural activity. So in the same way the harmonic patterns are building blocks of these complex patterns we see on animal coats, these connectome harmonics are the building blocks of the complex spatio-temporal patterns of neural activity.
Describing and explaining neural activity by using these connectome harmonics as brain states is really not very different than decomposing a complex musical pieces into its musical notes. It’s simply a new way of representing your data, or a new language to express it.
What is the advantage of using this new language? So why not use the state-of-the-art conventional neurimaging analysis methods? Because these connectome harmonics, by definition are the vibration modes, but applied to the anatomy of the human brain, and if you use them as brain states to express neural activity we can compute certain fundamental principles very easily such as the energy or the power.
The power would be the strength of activation of each of these states in neural activity. So how strongly that particular state contributes to neural activity. And the energy would be a combination of this strength of activation with the intrinsic energy of that particular brain state, and the intrinsic energy comes from the frequency of its vibration (in the analogy of vibration).
So in this study we looked at the power and the energy of these connectome harmonic brain states in order to explore the neural correlates of the LSD experience.
We looked at 12 healthy participants who received either 75µg of LSD (IV) or a placebo, over two sessions. These two sessions were 14 days apart in counter-balanced order. And the fMRI scans consisted of 3 eyes-closed resting states scans, each lasting 7 minutes, in the first and the third scan the participants were simply resting, eyes closed, but in the second scan they were also listening to music. And after each scan, the participants rated the intensity of certain experiences.
So if you look at, firstly, at the total power and the total energy of each of these scans under LSD and placebo, what we see is that under LSD both the power as well as the energy of brain activity increases significantly.
And if we compute the probability of observing a certain energy value on LSD or placebo, what we see is that the peak of this probability distribution clearly shoots towards high energy values under LSD.
And that peak is even slightly higher in terms of probability when the subjects were listening to music. So if we interpret that peak as, in a way, the characteristic energy of a state, you can see that it shifts towards higher energy under LSD, and that this effect is intensified when listening to music.
And then we asked, which of these brain states, which of these frequencies, were actually contributing to this energy increase. So we partitioned the spectrum of all of these harmonic brain states into different parts and computed the energy of each of these partitions individually. So in total we have around 20,000 brain states. And if you look at the energy differences in LSD and placebo, what we find is that for a very narrow range of low frequencies actually these brain states were decreasing their energy on LSD. But for a very broad range of high frequencies, LSD was inducing an energy increase. So this says that LSD alters brain dynamics in a very frequency-selective manner. And it was causing high frequencies to increase their energy.
So next we looked at whether these changes we are observing in brain activity are correlated with any of the experiences that the participants themselves were having in that moment. If you look at the energy changes within the narrow range of low frequencies, we found that the energy changes in that range significantly correlated with the intensity of the experience of ego dissolution. The loss of subjective self.
And very interestingly, the same range of energy change within the same frequency range also significantly correlated with the intensity of emotional arousal, whether the experience was positive or negative. This could be quite relevant for studies looking into potential therapeutic applications of LSD.
Next, when we look at a slightly higher range of frequencies, what we found was that the energy changes within that range significantly correlated with the positive mood.
In brief, this suggests that it’s rather the low frequency brain states which correlated with ego dissolution or with emotional arousal, and it’s the activity of higher frequencies that is correlated with the positive experiences.
Next, we wanted to check the size of the repertoire of active brain states. And if you look at the probability of activation for any brain state (so we are not distinguishing for any frequency brain states), what we observe is that the probability of a brain state being silent (zero contribution), actually decreased under LSD. And the probability of a brain state contributing very strongly, which corresponds to the tails of these distributions, were increased under LSD. So this suggests that LSD was activating more brain states simultaneously.
And if we go back to the music analogy that we used in the beginning, that would correspond to playing more musical notes at the same time. And it’s very interesting, because studies that have looked at improvising, those who have looked at jazz improvisation, show that improvising jazz musicians play significantly more musical notes compared to memorized play. And this is what we seem to be finding under the effect of LSD. That your brain is actually activating more of these brain states simultaneously.
And it does so in a very non-random fashion. So if you look at the correlation across different frequencies. Like at the co-activation patterns, and their activation over time. You may interpret it as the “communication across various frequencies”. What we found is that for a very broad range of the spectrum, there was a higher correlation across different frequencies in their activation patterns under LSD compared to placebo.
So this really says that LSD is actually causing a reorganization, rather than a random activation of brain states. It’s expanding the repertoire of active brain states, while maintaining -or maybe better said- recreating a complex but spontaneous order. And in the musical analogy it’s really very similar to jazz improvisation, to think about it in an intuitive way.
Now, there is actually one particular situation when dynamical systems such as the brain, and systems that change their activity over time, show this type of emergence of complex order, or enhanced improvisation, enhanced repertoire of active states. And this is when they approach what is called criticality. Now, criticality is this special type of behavior, special type of dynamics, that emerges right at the transition between order and chaos. When these two (extreme) types of dynamics are in balance. And criticality is said to be “the constantly shifting battle zone between stagnation and anarchy. The one place where a complex system can be spontaneous, adaptive, and alive” (Waldrop 1992). So if a system is approaching criticality, there are very characteristic signatures that you would observed in the data, in the relationships that you plot in your data.
And one of them is -and probably the most characteristic of them- is the emergence of power laws. So what does that mean? If you plot one observable in our data, which for example, in our case would be the maximum power of a brain state, in relationship to another observable, for example, the wavenumber, or the frequency of that brain state, and you plot them in logarithmic coordinates, that would mean that if they follow power laws, they would approximate a line. And this is exactly what we observe in our data, and surprisingly for both LSD as well as for placebo, but with one very significant and remarkable difference: because the high frequencies increase their power on LSD, this distribution follows this power law, this line, way more accurately under LSD compared to placebo. And here you see the error of the fit, which is decreasing.
This suggests that LSD shoots brain dynamics further towards criticality. The signature of criticality that we find in LSD and in placebo is way more enhanced, way more pronounced, under the effect of LSD. And we found the same effect, not only for the maximum power, but also for the mean power, as well as for the power of fluctuations.
So this suggests that the criticality actually may be the principle that is underlying this emergence of complex order, and this reorganization of brain dynamics, and which leads to enhanced improvisation in brain activity.
So, to summarize briefly, what we found was that LSD increases the total power as well as total energy of brain activity. It selectively activates high frequency brain states, and it expands the repertoire or active brain states in a very non-random fashion. And the principle underlying all of these changes seems to be a reorganization of brain dynamics, right at criticality, right at the edge of chaos, or just as the balance between order and chaos. And very interestingly, the “edge of chaos”, or the edge of criticality, is said to be where “life has enough stability to sustain itself, and enough creativity to deserve the name of life” (Waldrop 1992). So I leave you with that, and thank you for your attention.
I wrote the following in response to a comment on the r/RationalPsychonaut subreddit about this DMT article I wrote some time ago. The comment in question was: “Can somebody eli5 [explain like I am 5 years old] this for me?” So here is my attempt (more like “eli12”, but anyways):
In order to explain the core idea of the article I need to convey the main takeaways of the following four things:
Differential geometry,
How it relates to symmetry,
How it applies to experience, and
How the effects of DMT turn out to be explained (in part) by changes in the curvature of one’s experience of space (what we call “phenomenal space”).
1) Differential Geometry
If you are an ant on a ball, it may seem like you live on a “flat surface”. However, let’s imagine you do the following: You advance one centimeter in one direction, you turn 90 degrees and walk another centimeter, turn 90 degrees again and advance yet another centimeter. Logically, you just “traced three edges of a square” so you cannot be in the same place from which you departed. But let’s says that you somehow do happen to arrive at the same place. What happened? Well, it turns out the world in which you are walking is not quite flat! It’s very flat from your point of view, but overall it is a sphere! So you ARE able to walk along a triangle that happens to have three 90 degree corners.
That’s what we call a “positively curved space”. There the angles of triangles add up to more than 180 degrees. In flat spaces they add up to 180. And in “negatively curved spaces” (i.e. “negative Gaussian curvature” as talked about in the article) they add up to less than 180 degrees.
Eight 90-degree triangles on the surface of a sphere
So let’s go back to the ant again. Now imagine that you are walking on some surface that, again, looks flat from your restricted point of view. You walk one centimeter, then turn 90 degrees, then walk another, turn 90 degrees, etc. for a total of, say, 5 times. And somehow you arrive at the same point! So now you traced a pentagon with 90 degree corners. How is that possible? The answer is that you are now in a “negatively curved space”, a kind of surface that in mathematics is called “hyperbolic”. Of course it sounds impossible that this could happen in real life. But the truth is that there are many hyperbolic surfaces that you can encounter in your daily life. Just to give an example, kale is a highly hyperbolic 2D surface (“H2” for short). It’s crumbly and very curved. So an ant might actually be able to walk along a regular pentagon with 90-degree corners if it’s walking on kale (cf. Too Many Triangles).
An ant walking on kale may infer that the world is an H2 space.
In brief, hyperbolic geometry is the study of spaces that have this quality of negative curvature. Now, how is this related to symmetry?
2) How it relates to symmetry
As mentioned, on the surface of a sphere you can find triangles with 90 degree corners. In fact, you can partition the surface of a sphere into 8 regular triangles, each with 90 degree corners. Now, there are also other ways of partitioning the surface of a sphere with regular shapes (“regular” in the sense that every edge has the same length, and every corner has the same angle). But the number of ways to do it is not infinite. After all, there’s only a handful of regular polyhedra (which, when “inflated”, are equivalent to the ways of partitioning the surface of a sphere in regular ways).
If you instead want to partition a plane in a regular way with geometric shapes, you don’t have many options. You can partition it using triangles, squares, and hexagons. And in all of those cases, the angles on each of the vertices will add up to 360 degrees (e.g. six triangles, four squares, or thee corners of hexagons meeting at a point). I won’t get into Wallpaper groups, but suffice it to say that there are also a limited number of ways of breaking down a flat surface using symmetry elements (such as reflections, rotations, etc.).
Regular tilings of 2D flat space
Hyperbolic 2D surfaces can be partitioned in regular ways in an infinite number of ways! This is because we no longer have the constraints imposed by flat (or spherical) geometries where the angles of shapes must add up to a certain number of degrees. As mentioned, in hyperbolic surfaces the corners of triangles add up to less than 180 degrees, so you can fit more than 6 corners of equilateral triangles at one point (and depending on the curvature of the space, you can fit up to an infinite number of them). Likewise, you can tessellate the entire hyperbolic plane with heptagons.
Hyperbolic tiling: Each of the heptagons is just as big (i.e. this is a projection of the real thing)
On the flip side, if you see a regular partitioning of a surface, you can infer what its curvature is! For example, if you see that a surface is entirely covered with heptagons, three on each of the corners, you can be sure that you are seeing a hyperbolic surface. And if you see a surface covered with triangles such that there are only four triangles on each joint, then you know you are seeing a spherical surface. So if you train yourself to notice and count these properties in regular patterns, you will indirectly also be able to determine whether the patterns inhabit a spherical, flat, or hyperbolic space!
3) How it applies to experience
How does this apply to experience? Well, in sober states of consciousness one is usually restricted to seeing and imagining spherical and flat surfaces (and their corresponding symmetric partitions). One can of course look at a piece of kale and think “wow, that’s a hyperbolic surface” but what is impossible to do is to see it “as if it were flat”. One can only see hyperbolic surfaces as projections (i.e. where we make regular shapes look irregular so that they can fit on a flat surface) or we end up contorting the surface in a crumbly fashion in order to fit it in our flat experiential space. (Note: even sober phenomenal space happens to be based on projective geometry; but let’s not go there for now.)
4) DMT: Hyperbolizing Phenomenal Space
In psychedelic states it is common to experience whatever one looks at (or, with more stunning effects, whatever one hallucinates in a sensorially-deprived environment such as a flotation tank) as slowly becoming more and more symmetric. Symmetrical patterns are attractors in psychedelia. It’s common for people to describe their acid experiences as “a kaleidoscope of colors and meaning”. We should not be too quick to dismiss these descriptions as purely metaphorical. As you can see from the article Algorithmic Reduction of Psychedelic States as well as PsychonautWiki’s Symmetrical Texture Repetition, LSD and other psychedelics do in fact “symmetrify” the textures you experience!
What gravel might look like on 150 mics of LSD (Source)
As it turns out, this symmetrification process (what we call “lowering the symmetry detection/propagation threshold”) does allow one to experience any of the possible ways of breaking down spherical and flat surfaces in regular ways (in addition to also enabling the experience of any wallpaper group!). Thus the surfaces of the objects one hallucinates on LSD (specially for Closed Eyes Visuals), are usually carpeted with patterns that have either spherical or flat symmetries (e.g. seeing honeycombs, square grids, regular triangulations, etc.; or seeing dodecahedra, cubes, etc.).
17 wallpaper symmetry groups
Only on very high doses of classic psychedelics does one start to experience objects that have hyperbolic curvature. And this is where DMT becomes very relevant. Vaping it is one of the most efficient ways of achieving “unworldly levels of psychedelia”:
On DMT the “symmetry detection threshold” is reduced to such an extent that any surface you look at very quickly gets super-saturated with regular patterns. Since (for reasons we don’t understand) our brain tries to incorporate whatever shape you hallucinate into the scene as part of the scene, the result of seeing too many triangles (or heptagons, or whatever) is that your brain will “push them into the surfaces” and, in effect, turn those surfaces into hyperbolic spaces.
Yet another part of your brain (or system of consciousness, whatever it turns out to be) recognizes that “wait, this is waaaay too curved somehow, let me try to shape it into something that could actually exist in my universe”. Hence, in practice, if you take between 10 and 20 mg of DMT, the hyperbolic surfaces you see will become bent and contorted (similar to the pictures you find in the article) just so that they can be “embedded” (a term that roughly means “to fit some object into a space without distorting its properties too much”) into your experience of the space around you.
But then there’s a critical point at which this is no longer possible: Even the most contorted embeddings of the hyperbolic surfaces you experience cannot fit any longer in your normal experience of space on doses above 20 mg, so your mind has no other choice but to change the curvature of the 3D space around you! Thus when you go from “very high on DMT” to “super high on DMT” it feels like you are traveling to an entirely new dimension, where the objects you experience do not fit any longer into the normal world of human experience. They exist in H3 (hyperbolic 3D space). And this is in part why it is so extremely difficult to convey the subjective quality of these experiences. One needs to invoke mathematical notions that are unfamiliar to most people; and even then, when they do understand the math, the raw feeling of changing the damn geometry of your experience is still a lot weirder than you could ever anticipate.
Anybody else want to play hyperbolic soccer? Humans vs. Entities, the match of the eon!
Now that you understand the gist of the original article, I encourage you to take a closer look at it, as it includes content that I didn’t touch in this ELI5 (or 12) summary. It provides a granular description of the 6 levels of DMT experience (Threshold, Chrysanthemum, Magic Eye, Waiting Room, Breakthrough, and Amnesia), many pictures to illustrate the various levels as well as the particular emergent geometries, and a theoretical discussion of the various algorithmic reductions that might explain how the hyperbolization of phenomenal space takes place based on combining a series of simpler effects together.
[Our] subjective conscious experience exhibits a unitary and integrated nature that seems fundamentally at odds with the fragmented architecture identified neurophysiologically, an issue which has come to be known as the binding problem. For the objects of perception appear to us not as an assembly of independent features, as might be suggested by a feature based representation, but as an integrated whole, with every component feature appearing in experience in the proper spatial relation to every other feature. This binding occurs across the visual modalities of color, motion, form, and stereoscopic depth, and a similar integration also occurs across the perceptual modalities of vision, hearing, and touch. The question is what kind of neurophysiological explanation could possibly offer a satisfactory account of the phenomenon of binding in perception?
One solution is to propose explicit binding connections, i.e. neurons connected across visual or sensory modalities, whose state of activation encodes the fact that the areas that they connect are currently bound in subjective experience. However this solution merely compounds the problem, for it represents two distinct entities as bound together by adding a third distinct entity. It is a declarative solution, i.e. the binding between elements is supposedly achieved by attaching a label to them that declares that those elements are now bound, instead of actually binding them in some meaningful way.
Von der Malsburg proposes that perceptual binding between cortical neurons is signalled by way of synchronous spiking, the temporal correlation hypothesis (von der Malsburg & Schneider 1986). This concept has found considerable neurophysiological support (Eckhorn et al. 1988, Engel et al. 1990, 1991a, 1991b, Gray et al. 1989, 1990, 1992, Gray & Singer 1989, Stryker 1989). However although these findings are suggestive of some significant computational function in the brain, the temporal correlation hypothesis as proposed, is little different from the binding label solution, the only difference being that the label is defined by a new channel of communication, i.e. by way of synchrony. In information theoretic terms, this is no different than saying that connected neurons posses two separate channels of communication, one to transmit feature detection, and the other to transmit binding information. The fact that one of these channels uses a synchrony code instead of a rate code sheds no light on the essence of the binding problem. Furthermore, as Shadlen & Movshon (1999) observe, the temporal binding hypothesis is not a theory about how binding is computed, but only how binding is signaled, a solution that leaves the most difficult aspect of the problem unresolved.
I propose that the only meaningful solution to the binding problem must involve a real binding, as implied by the metaphorical name. A glue that is supposed to bind two objects together would be most unsatisfactory if it merely labeled the objects as bound. The significant function of glue is to ensure that a force applied to one of the bound objects will automatically act on the other one also, to ensure that the bound objects move together through the world even when one, or both of them are being acted on by forces. In the context of visual perception, this suggests that the perceptual information represented in cortical maps must be coupled to each other with bi-directional functional connections in such a way that perceptual relations detected in one map due to one visual modality will have an immediate effect on the other maps that encode other visual modalities. The one-directional axonal transmission inherent in the concept of the neuron doctrine appears inconsistent with the immediate bi-directional relation required for perceptual binding. Even the feedback pathways between cortical areas are problematic for this function due to the time delay inherent in the concept of spike train integration across the chemical synapse, which would seem to limit the reciprocal coupling between cortical areas to those within a small number of synaptic connections. The time delays across the chemical synapse would seem to preclude the kind of integration apparent in the binding of perception and consciousness across all sensory modalities, which suggests that the entire cortex is functionally coupled to act as a single integrated unit.
— Section 5 of “Harmonic Resonance Theory: An Alternative to the ‘Neuron Doctrine’ Paradigm of Neurocomputation to Address Gestalt properties of perception” by Steven Lehar
Only when sexual choice favored the reportability of our subjective experiences- with the emergence of the mental clearing-house we call consciousness- did our strangely promiscuous introspection abilities emerge, such that we seem to have instant conscious access to such a range of impressions, ideas, and feelings. This may explain why philosophical writing about consciousness so often sounds like love poetry- philosophers of mind, like lovesick teenagers, dwell upon the redness of the rose, the emotional urgency of music, the soft warmth of skin, and the existential loneliness of the self. The philosophers wonder why such subjective experiences exist, given that they seem irrelevant to our survival prospects, while the lovesick teenagers know perfectly well that their romantic success depends, in part, on making a credible show of aesthetic sensitivity to their own conscious pleasures.
– The Mating Mind: How Sexual Choice Shaped the Evolution of Human Nature (pg. 365) by Geoffrey F. Miller
A Darwinian Set and Setting
According to The Mating Mind, human sexual selection favors particular fitness-indicating traits, both physical and mental. In the context of mental traits, we have verbal and introspective abilities, agreeableness, conscientiousness, openness to experience, low neuroticism and extroversion. No matter how verbally capable and introspective a given person is, unless that is balanced with some degree of agreeableness, conscientiousness, etc. the person will not be all that attractive. But, when all else is being held equal, stronger verbal and introspective abilities are favored. Teenagers, arguably, know this best of all: courtship is intensely verbal.
Our minds evolved in a Darwinian environment. If people like Miller are right in thinking that language evolved as a fitness indicator, we are right to expect that the way we think and verbalize is biased to be impressive to the members of the opposite sex during courtship. Powerful introspective abilities, as it were, can make one’s language seem deeper, more romantic, and even at an entirely different level than that of one’s peers. In this backdrop of sexual choices and judgements, it is not surprising that humans would develop ever-increasing verbal and introspective capacities. At some point everyday life could not present sufficient opportunities for people, especially males, to show off their own abilities. And as these abilities increased over time, culture was forced to invent handicaps so that people could display their top capabilities. Over time, elaborate and competitive handicaps were integrated into the culture. Even verbal and introspective abilities at the top of the scale can still be compared side by side by using carefully selected handicaps: for example, poetry is exactly that; rhyme, rhythm and meter make it easier for the best poets to show off their excellent abilities. The handicaps adjust to the maximum level of competence in the population.
The space of handicaps that are used to show off traits that are reliable indicators of fitness is very large. From Greek Symposiums to modern day Frat Parties, Western civilization has embraced a niche subculture that uses chemical handicaps as a means to display verbal, social and creative skills. If you can philosophize after drinking a gallon of wine, or stay capable of managing the playlist after 16 cheap cans of beer, you are showing off your biological robustness. Clearly, many of our ancestors were capable of impressing potential sexual mates with a mixture of booze, loud music and stunning philosophical conversations.
One could argue that psychedelics have come to disrupt our traditional games of handicaps. “Sure you can drink a bottle of tequila and sing in a band, but can you take three hits of acid and tell me what your experience reveals about the intrinsic nature of consciousness?” Psychedelics are, in a way, a cultural hyper-stimulus that presents the most difficult and interesting handicap currently in existence for verbal and introspective abilities.
Cultures can have an allergic reaction to the states of consciousness that these agents can disclose; people are afraid that psychedelic users will discover something that they themselves don’t know. Notably, psychedelicists have been both demonized and deified since the 60s. Sure, these researchers became extremely open minded, and in many ways weird. But, above all, they became extremely interesting people. And interesting people who challenge the current games of status can cause cultural allergic reactions.
Every acid head and psychedelic researcher has a pet theory of what these compounds are really doing in one’s mind. Many of these folk theories about the effects of psychedelics involve ontologies that currently have little scientific support (such as souls, thought fields, spirit worlds, archetypes, alien conspiracies, and so on). Although we cannot rule out explanations of this sort out of hand, the ontologies themselves are so abstract and poorly defined that we cannot accept them as useful forms of reductions. That said, their future versions will be more interesting. It is likely that committed, rational, spiritual psychedelic users will formalize models of this sort at some point. Rather than talking about a “spirit world,” they will talk about “mind-independent extra-dimensional space that consciousness can access in altered states” and then go on to define the differential equations that govern consciousness’s interactions with this space. When this happens, we will be in a much better position to assess the validity of these models, test the reality of those spaces, and perhaps even recruit the extra-dimensional inhabitants of these worlds for computational tasks.
Psychedelic experiences drastically increase people’s introspection, capacity for deep aesthetic appreciation, while at the same time increasing their ability to entertain unusual ideas. Insofar as the selection pressures of our introspective abilities have been heavily biased towards courtship ability, it is not surprising that people tend to immediately cast self-enhancing, life-affirming and magical narratives into their interpretations of their personal psychedelic experiences. After all, having a very interesting story to tell is highly praised during courtship. Are people’s psychedelic narratives a modern day form of the peacock’s tail? While psychedelic talk does not yet form part of any mainstream game of courtship, I envision this changing in the next decades. Undoubtedly, the most insightful, sound, and scientifically rigorous members of the Super-Shulgin Academy will attract attention, status, resources and… desirable mates.
What is the deep structure of psychedelic experiences?
Psychedelics seem to have a generalized effect on one’s consciousness. At minimum, we could talk of experience amplification. Without delving into specifics, psychedelics introduce spontaneous activity into our consciousness that our mind is compelled to integrate somehow. Our state of consciousness changes dynamically as our mind adjusts itself to the incoming stimulation. The result is tightly dependent on the interplay between our brain anatomy, motivational system and the actual changes to the micro-structure of consciousness induced by LSD.
As John Lilly noted in light of his psychedelic experiences: “in the province of the mind, what one believes to be true is true or becomes true, within certain limits to be found experientially and experimentally. These limits are further beliefs to be transcended. In the mind, there are no limits…”.* While there are reasons not to take this literally, we have grounds for claiming that a large number of limits on our experience are placed there by our deeply held beliefs and attitudes. The space of possible LSD experiences that a single individual can experience is much larger than what said individual will typically be able to explore in practice. Many limits are imposed by his or her beliefs and background assumptions, rather than by physiology per se. Social cognition is a profound attractor in psychedelic experiences. “What will I say about this? What would this person think about this experience? etc.” are captivating thoughts. However, they occupy valuable mental space. And the thick mental judgements that people naturally focus on come with large conceptual and emotional baggage that taints the experience. Meditators, philosophers and scientists are more likely to set aside some time during their explorations to delve more deeply into what the energy introduced by LSD can produce in one’s consciousness.
After extreme training and tens (or hundreds) of trips, dedicated psychonauts will discover qualities that all of the trips share. Most people will likely experience a variant of Lilly’s realization that whatever you believe can be perceived as true during psychedelic experiences. Lilly emphasized the limitless quality of the mind, but one must wonder: If one can experience as true anything conceivable, are we not, then, limited by what we can conceive? No matter how much time one spends with an open mind waiting for new and interesting ideas to take shape, one cannot know the nature of what one has not yet even conceived of.
It may be true that we will always find fundamental limits that cannot be overcome. There are fundamental physiological constraints to the possible configurations of our consciousness, and arguably, chemical agents, while capable of expanding the space of possibilities, will not automatically give access to all possible states of consciousness. As future research is likely to show, 2C-B and LSD probably facilitate slightly different kinds of thoughts and experiences. Thus the limits of our mind are at least to a large extent the result of our physiology. Memes and meditation can only go so far.
In addition to physiological limits, the structure of the state-space of qualia is itself a constraint on what can and cannot be experienced. To the extent that psychedelic states enable the exploration of a larger space of possible experiences, we are more likely while on psychedelics to find states of consciousness that demonstrate fundamental limits imposed by the structure of the state-space of qualia. In normal everyday experience we can see that yellow and blue cannot be mixed (phenomenologically), while yellow and red can (and thus deliver orange). This being a constraint of the state-space of qualia itself is not at all evident, but it is a good candidate and many introspective individuals agree. On psychedelic states one can detect many other rules like that, except that they operate on much higher-dimensional and synesthetic spaces (E.g. “Some feelings of roughness and tinges of triangle orange can mix well, while some spiky mongrels and blue halos simply won’t touch no matter how much I try.” – 150 micrograms of LSD).
One of the objectives of Qualia Computing is to define the state space of possible experiences and the interdependencies between them. While normal everyday states of consciousness are important datapoints, I predict that the bulk of the most useful information will come from studying the behavior and mechanics of consciousness in radically altered states. To this end, however, we should focus on simple explanations that can be generalized to all psychedelic experiences.
Starting Background Assumptions
For the purpose of this article I will assume that direct realism, in all of its guises, is wrong. That is, I will assume that any mind-independent object can only be experienced indirectly. What we experience is not the object (or beings) themselves, but a qualia-furnished representation entirely contained within one’s mind (this is often called the simulationist account of perception). Furthermore, I will also assume that the behavior of the universe can be fully described with the Standard Model of physics (or a future version of it).
In what is to follow I will propose, as a first approximation, an algorithmic reduction of psychedelic states; I will propose a set of changes in our consciousness that (1) is as simple and assumption-free as possible, and (2) can be used to reconstruct as many psychedelic effects as possible.
Two Kinds of Reduction
The word reduction in the context of philosophy of science has a lot of historical and conceptual baggage. In the context of this article, I will use the word in the following sense: We say that a property of a given phenomenon X reduces to Y if we can fully explain X’s property by referencing Y’s properties. X can be a physical phenomenon, a mathematical construct or even an experience. Y is an ontology with interaction rules, which allow the pieces of said ontology to interact with one another. We do not commit to the idea that Y itself needs to be the fundamental (or true) ontology of X. But we do want to make sure that Y is at least more fundamental than X in some appropriate sense. So what kind of ontologies can Y have? In the context of philosophy of mind, reductions usually attempt to account for not only the behavior of consciousness but also for its underlying nature. Thus, functionalism is both a reduction program as well as a philosophical take on what the mind fundamentally is.
Thankfully, we do not need to commit to any ontology in order to advance a particular style of reduction. Reductions are useful regardless: they reduce the amount of information needed to describe a phenomenon, and if accurate, they can also make useful predictions. Finally, these reductions can provide hints for how to bridge different areas of science; by identifying isomorphisms or even further reductions, entire fields can cross-pollinate once their respective reductions are compatible (such as biology and chemistry or chemistry and physics).
Atomistic Reduction
For most intents and purposes, science relies on a particular kind of reduction that we can call atomistic reduction. This style of reduction focuses on explaining macroscopic phenomena by modeling it as the emergent structure of many particles interacting with one another at a much finer level of resolution. Even though this style of reduction is usually fruitful (e.g. thermodynamics), it can be counter-productive to assume in some situations. An extreme case would be the quantum computer. If states of superposition help a computer find an answer, it will be hard to explain the behavior of said superposition by postulating that it actually reduces to little particles interacting using simple rules. The model could in principle be worked out, but at the cost of very high complexity. It would be much easier to start with a quantum-mechanical ontology that allows the superposition of wavefunctions! Then what is left is to reduce the rest of the computer to quantum mechanics (which is possible, given that particle models and quantum mechanical models usually converge at the macroscopic limit).
It is tempting to try to reduce the properties of the mind (including psychedelic states) using an atomistic reduction. Unfortunately, the phenomenal binding problem adds a complication to this reduction. Rather than discussing (right now) whether an atomistic (and thus classical) account will ultimately be capable of modeling conscious experience, we will side-step this problem by using a different style of reduction. We will focus only on the algorithmic level of analysis.
Algorithmic Reduction
Without assuming a fundamental ontology (atoms, fields, wavefunctions, etc.) we can still make a lot of progress. We can restrict ourselves to identifying what we call an algorithmic reduction: find a set of procedures, state-spaces, shapes and overall main effects out of which you can reconstruct as much of the observed behavior as possible.
In reality, every reduction is, at least in part, an algorithmic reduction. By specifying a particular ontology such as “particles”, we restrict the shape of our possible reductions. By keeping the reduction at the algorithmic level, we allow arbitrary ontologies to be the final explanations (then depending on actual empirical measurements). The main criteria for success still includes (1) the overall complexity of the model, and (2) the explanatory power of the model. In other words, how easily and precisely does the model reconstruct the behavior of our experiences?
A Zoo of Psychedelic Effects
PsychonautWiki has a detailed and fascinating taxonomy of reported psychedelic visual effects. One could argue that all of these countless effects are completely unique. As a philosopher might put it, these effects may ultimately be qualitatively irreducible to one another. But what are the chances that a simple molecule would happen to trigger a whole zoo of unrelated effects? As a form of reduction, nothing is achieved by stating that every effect is its own unique phenomenon.
Four Principal Operators: A Simple Algorithmic Model of Psychedelic States
In trying to account for the strange effects of psychedelics, we will aim to propose as few main effects as possible and then use these effects, and their interactions, to derive all of the remaining effects. By doing this, we will be algorithmically reducing the complex phenomena found in psychedelic states. In turn, this will allow us to increase our understanding of the source of information processing benefits provided by psychedelic states, and to derive new and exciting applications of such states. Additionally, by identifying a good algorithmic reduction, we might be able to refine the states themselves, to amplify their benefits while minimizing the drawbacks.
The model we will treat for now has four main effects, and with those four effects we will attempt to reconstruct the rest. These effects are:
Symmetric drifting. What would Giulio Tononi think about this? Source.
Control interruption is the simplest and most universal psychedelic effect. It enables the buildup of qualia in one’s consciousness. People say that psychedelics are intense, deep, bright, etc. Every experience, whether a thought, a smell or an emotion, seems to be both stronger and longer-lasting on psychedelics.
Things seem more lively, and this is not because a switch is suddenly turned on and your experience of the current input is amplified. Rather, one seems to be experiencing a gentle overlap of many previous frames (and feature bundles) of one’s experience. In medium to high doses, this can give rise to solid frame stacking. In turn, the buildup of sensation creates complex patterns of interference:
In order for a perceptual system to transition from a linear to a nonlinear state, negative feedback control must be subverted. If control is entirely removed then perception becomes totally unconstrained, leaving a system that is quickly overloaded with too much information. If control is placed in a state where it is partially removed or in a toggled superposition where it is alternately in control and not in control over the period of a rapid oscillation, then the constraints of linear sensory throughput will bifurcate into a nonlinear spectrum of multi-stable output with signal complexity correlating to the functional interruption of control. Common entheogenic wisdom states that you must relinquish control and submit to the experience to get the most out of psychedelics. Holding onto control causes negative experiences and amplifies anxiety; letting go of control and embracing unconstrained perception is a central psychedelic tenet. This demonstrates that psychedelics directly subvert feedback control over linear perception to promote states of unconstrained consciousness.
– Control Interrupt Model of Psychedelic Action, PIT
Control interruption explains a large variety of effects, including the increase in the raw intensity (and amount) of experience, as well as the longer lasting positive afterimages (and thus tracers). Here we show a simple example of this effect. Consider the “original stimuli” to be what one experiences under a sober state. Likewise, consider the 9 squares to be different states of consciousness brought up by various psychotropic combinations.
Original
Stimuli with tracers
The 9 gifs you see above are simulations of control interruption using a simple feedback model (which we will describe in detail in a later article). The x-axis has different “echo strengths” while the y-axis has varying feedback strengths. These are two of the model parameters. Notice that the lower right corner is a credible rendition of something that people describe as moments of eternity. These are experiences where time seems to stop due to an over-saturation of regular and ordered qualia.
When considering the following effects, don’t forget that control interruption is also going on all the time. The stranger the psychedelic effect, the more intense it is.
Drifting is responsible for breathing walls, animated plants, feelings of boundary dissolution, merging and melting, and so on. Small amounts of drifting usually involve individual feature detachments from perceptual objects (such as the color and shape of a chair becoming dissociated). Medium amounts of drifting make textures flow constantly. If one’s experience was made of tiny magnetic gears that are usually aligned in a coherent way, drifting would result from increasing the overall energy of the system. Thus, the visual system is constantly descending to “more aligned local states” while incoming energy is constantly adding noise and destroying all of the alignment progress made.
A particularly salient aspect of drifting is that features and locally-bound fragments of experience can drift in any direction in 3D. Pieces of the wall don’t only drift left and right, but also forwards and backwards.
On high doses of psychedelics or synergistic combinations of dissociatives and psychedelics (e.g. LSD + nitrous, 2C-B + ketamine, etc.), drifting can become all-encompassing. A critical point is crossed when one loses the capacity to define a mainframeof experience (the dominating orientation-giving island of locally bound experience that we use as a reference point). When this happens, one feels like one cannot tell left from right, or up from down. One simply experiences a constant chaotic flow of experience. In some cases one can even spot interesting instabilities that resemble actual physical instabilities found in fluid mechanics (such as the Kelvin–Helmholtz instability).
Drifting does not occur in isolation, and its mechanics are dependent on the particular set and setting in which the psychedelic experience is developing. From a computational point of view, drifting can be useful because it allows a quick exploration of the state-space of possible local binding configurations between the phenomenal objects present in one’s experience. Indeed, not only does red fail to mix with green, but many of the synesthetic qualia varieties present in a scene with constant drifting will refuse to touch each other. Drifting feels like there is some sort of psychedelic energy (somewhat reminiscent of anxiety, but not restricted to body feelings) that overheats certain parts of one’s conscious experience, and in turn disassembles the local connections there.
Enhanced Pattern Recognition: This effect refers to the transient (but often powerful) lowering of the detection threshold for previously experienced patterns and known ontologies (e.g. animals, plants, people, etc.). Psychedelics, in other words, temporarily increase one’s degree of apophenia. Another name given to this effect is eidetic hallucinations. From a Bayesian point of view, the effect could be described thus: psychedelics intensify the effect of our priors. As explained in Getting Closer to Digital LSD, Google’s deep belief neural network inceptionist technique works by finding bundles of features that trigger high-level neurons (such as face-detectors, object-detectors, etc) at sub-threshold levels (e.g. “this almost looks like a frog”) and then modifying the picture so that the network more strongly detects those same high level features. This particular algorithm can be understood in terms of the pharmacological action of psychedelics: one can have breakthroughs of eidetic hallucinations by impairing the inhibitory control coming from the cortex.
In a sense we could say that while tracers are the result of “simple cell control interruption”, eidetic hallucinations are the result of “complex cell control interruption.” The former allows the build-up of colors, edges and simple shapes, while the latter amplifies the features that trigger high-level percepts such as faces and objects.
The way one directs attention during a psychedelic trip influences the way eidetic hallucinations evolve over time. For this reason any psychedelic replication movie will probably require human input (in the form of eye-tracking) in order to incorporate human saliency preferences and interests into an evolving virtual psychedelic trip simulated with the Inceptionist Method.
Lower Symmetry Detection and Propagation Thresholds:Finally, this is perhaps the most interesting and scientifically salient effect of psychedelics. The first three effects are not particularly difficult to square with standard neuroscience. This fourth effect, while not incompatible with connectionist accounts, does suggest a series of research questions that may hint at an entirely new paradigm for understanding consciousness.
I have not seen anyone in the literature specifically identify this effect in all of its generality. The lowering of the symmetry detection threshold really has to be experienced to be believed. I claim that this effect manifests in all psychedelic experiences to a greater or lesser extent, and that many effects can in fact be explained by simply applying this effect iteratively.
Psychedelics make it easier to find similarities between any two given phenomenal objects. When applied to perception, this effect can be described as a lowering of the symmetry detection threshold. This effect is extremely general and symmetry should not be taken to exclusively refer to geometric symmetry.
How symmetries manifest depends on the set and setting. Researchers interested in verifying and exploring the quantitative and subjective properties of this effect will probably have to focus first on a narrow domain; the effect happens in all experiential modalities.
For now, let us focus on the case of visual experience. In this domain, the effect is what PsychonautWiki calls Symmetrical Texture Repetition:
Credit: Chelsea Morgan from PsychonautWiki and r/replications
Symmetry detection can be (and typically is) recursively applied to previously detected symmetry bundles. A given symmetry bundle is a set of n-dimensional symmetry planes (lines, hyperplanes, etc.) for which the qualities of the experience surrounding this bundle obey the symmetry constraints imposed by these planes. The planes can create mirror, rotational or oblique symmetry. Each symmetry bundle is capable of establishing a merging relationship with another symmetry bundle. These relationships are fleeting, but they influence the evolution of the relative position of each plane of symmetry. When x symmetry planes are in a merging relationship, one’s mind tries to re-arrange them (often using drifting) to create a symmetrical arrangement of these x symmetry planes. To do so, the mind detects one (or several) more symmetry planes, along which the previously-existing symmetry planes are made to conform, to organize in a symmetrical way (mirror, rotational, translational or otherwise). There is an irresistible subjective pull towards those higher levels of symmetry. The direction of highest symmetry and meta-symmetry feels blissful, interesting, mind-expanding, and awe-producing.
If one meditates in a sensorially-minimized room during a psychedelic experience while being aware that one’s symmetry detection threshold has been lowered by the substance, one can recursively re-apply this effect to produce all kinds of complex mathematical structures in one’s mind.
In the future, perhaps at a Super-Shulgin Academy, people will explore and compare the various states of consciousness that exhibit peak symmetry. These states would be the result of iteratively applying symmetry detection, amplification and re-arrangement. We would see fractals, tessellations, graphs and higher dimensional projections. Which one of these experiences contains the highest degree of inter-connectivity? And if psychedelic symmetry is somehow related to conscious bliss, which experience of symmetry is human peak bliss?
Scale-Free Fractal
Higher Order Symmetry
Mirror Symmetry Tessellation
Symmetrical Manifold
The pictures above all illustrate possible peak symmetry states one can achieve by combining psychedelics and meditation. The pictures illustrate only the core structure of symmetries that are present in these states of consciousness. What is being reflected is the very raw “feels” of each patch of your experiential field. Thus these pictures really miss the actual raw feelings of the whole experience. They do show, however, a rough outline of symmetrical relationships possible in one of these experiences.
Since control interruption is also co-occurrent with the psychedelic symmetry effect, previously-detected symmetries tend to linger for long periods of time. For this reason, the kinds of symmetries one can detect at a given point in time is a function of the symmetries that are currently being highlighted. And thanks to drifting and pattern recognition enhancement, there is some wiggle room for your mind to re-arrange the location of the symmetries experienced. The four effects together enable, at times, a smooth iterative integration of so many symmetries that one’s consciousness becomes symmetrically interconnected to an unbelievable degree.
What may innocently start as a simple two-sided mirror symmetry can end up producing complex arrangements of self-reflecting mirrors showing glimpses of higher and higher dimensional symmetries. Studying the mathematical properties of the allowed symmetries is a research project that has only just begun. I hope one day dedicated mathematicians describe in full the class of possible high-order symmetries that humans can experience in these states.
Anecdotally, each of the 17 possible wallpaper symmetry groups can be instantiated with this effect. In other words, psychedelic states lower the symmetry detection threshold for all of the mathematically available symmetrical tessellations.
All of the 17 2-dimensional wallpaper groups can be experienced with symmetry planes detected, amplified and re-arranged during a psychedelic experience.
Revising the symmetrical texture repetition of grass shown above, we can now discover that the picture displays the wallpaper symmetry found in the lower left circle above:
In very high doses, the symmetry completion is so strong that at any point one risks confusing left and right, and thus losing grasp of one’s orientation in space and time. Depersonalization is, at times, the result of the information that is lost when there is intense symmetry completion going on. One’s self-models become symmetrical too quickly, and one finds it hard to articulate a grounded point of view.
The Micro-Structure of Consciousness
At Qualia Computing we explore models of consciousness that acknowledge the micro-structure of consciousness. Experiences are not just higher-order mental operations applied to propositional content. Rather, an instant of experience contains numerous low-level textural properties. This is true for every sensory modality, and I would argue, even for the what-its-likeness of thought itself. Even just thinking about a mathematical idea (ex. “the intersection of two arbitrary sets”) is done by interacting with a background of raw feels, and these raw feels determine our attitudes and interactions with the ideas we are trying to abstract (some people, for example, experience emotional distress when trying out mathematical problems, and this is not because certain mathematical spaces are inherently unpleasant or anxiety-inducing).
In the case of vision, the micro-structure of consciousness is capable of supporting at least the following low-level features: color, color gradients, points, edges, oriented movement, and acceleration. A full conversation about the range of visual features that we are capable of experiencing is a discussion for another time. But for the time being, it will suffice to point out that (static) models of peripheral vision only need 5 summary statistics. With only five summary stats you can create textures that a human will find impossible to distinguish in peripheral vision.
These so-called mongrels are texturalmetamers (equivalence classes of subjectively indistinguishable input patterns). The state-space of perceivable visual textures is the space of possible mongrels, and that is an example of the sort of micro-structure we are looking for. Unlike the cozy high-definition space inscribed in the fovea, most of the information found in our sensory modalities comes in the form of textures that are mappable to state-spaces of summary statistics.
Psychedelic symmetry detection and amplification operates on the inner structure of mongrels. The fact that the mongrels are the objects becoming symmetric is something that can elude introspection until someone points it out. It happens right in front of any tripper’s eyes and yet people don’t seem to report it very often (if at all). This may be a result of the fact that the fine-grained structure of consciousness is rarely a topic of conversation, and that we usually describe what we see in the fovea (unless we have no other option). Our words usually refer to whole percepts or, at best, the simplest raw values of experience (such as the hue of colors or the presence of edges). And yet, the structure of our mongrels is quite obvious once symmetry propagation has conformed a large patch of your experience to have a tessellated identical mongrel repeating across it.
How Are these Components Related to Each Other?
The Kaleidoscopic technique to induce qualia annealing relies on a combination of drifting and symmetry detection in order to resolve implicit inconsistencies within one’s own memory gestalts. As we live and grow our experienced evidence base, we accumulate memories and impressions of many worldviews. Each worldview is, in a way, a response to all of the previous ones (or at least the memorable ones) and the current situation and the problems one is facing. Thanks to the four effects here described, a person can utilize a psychedelic state to increase the probability of the systematic co-occurrence of (usually) mutually-exclusive gestalts (worldviews) and thus enable their mutual awareness. And with mutual awareness, the symmetry detection and amplification effect creates (somehow forcefully) a unified phenomenal object that incorporates the inconsistent views into an unbiased (or less biased) point of view. One can achieve a higher order of memetic and affective integration.
Given the symmetry detection and amplification property of psychedelics, one can reasonably argue that psychedelic states may be able to reveal the properties of the micro-structure of consciousness. Timothy Leary, among others, described LSD as a sort of microscope for one’s psyche. The very word psychedelic means mind-manifest (the manifestation of one’s mind). Given the four components of these experiences, the fact that psychedelics work as some sort of microscope should not be surprising. Symmetry detection and control interruption multiply the amount of raw experience, while pattern recognition shows you what you are expecting (your priors become evident) and drifting makes the fleeting synesthetic effects malleable and easier to move around. People generally agree that psychedelics can show you subtle aspects of your own mind with stark clarity. But can they reveal the intrinsic properties of the nature of qualia at the most fundamental level?
The way to achieve this may be to create a fractal structure of symmetries in such a way that any tiny part of one’s experience can get reflected throughout the entirety of the phenomenal structure. One can then use eidetic hallucinations (or further symmetry detection) to focus and stabilize the fractal structure. Thus one would multiply the surface area of all of one’s attention into countless replicas of the micro-structure of a given part of one’s experience. A fractal kaleidoscopic mirror amplifier chamber is exactly what I imagine when I think about how to analyze the fine-grained structure of consciousness. And it so happens that meditation plus psychedelics can allow you to (fleetingly) build just that.
Psychedelic Introspectoscope (fractal kaleidoscope of generalized symmetries) to amplify arbitrary qualia values (such as particular emotions, phenomenal colors, synesthetic inter-junctions, etc.)
Any subtle qualia space can be multiplied countless times in such a way that all of one’s experience becomes a coherent interlocking structure that can be perceived all at once. If one wants to study, for example, the possible interactions between two hues of color, one can amplify the boundary between two regions that make the desired contrast of hues and make the entire fractal structure amplify this boundary hundreds of times.
Arguably, if one discovers that certain qualia values cannot be mixed in the introspectoscope (such as blue and yellow), one may still not know if these are fundamental constraints, or if they are the result of our connectome structure. If, on the other hand, two qualia values can mix in the introspectoscope, then we would know that they are not fundamentally mutually exclusive. Thus we would find out relational properties of the very state-space of qualia.
Reducing All Effects
Can we derive all psychedelic effects using the four components discussed above? While this is not yet possible, I trust that further work will show how most of the weird (and weirder) effects of psychedelics may be reduced to relatively simple (but not always atomistic) algorithms applied to the micro-structure of consciousness. I anticipate that we will discover that high doses actually produce entirely new effects (for example, what happens on 400 micrograms of LSD often include qualitative jumps from what happens at 150 micrograms). To note, ontological qualia and other subtle aspects of consciousness may resist reduction for still many more decades to come.
**An Introspectoscope is a hypothetical apparatus that enables a person to study the deep structure of his or her own consciousness. The concept comes from a paper in the making by Andrew Y. Lee. Obviously this comes with significant challenges. Some challenges come from the fact that we are trying to analyze something very small, and other challenges come from the fact we are trying to analyze qualia. Additionally, there are unique challenges that come from analyzing microscopic qualia qua microscopic qualia. I suggest that we use methods that amplify the micro-structure by taking advantage of fractal states: recursive and scale-free symmetry planes can amplify anything minute to a prominent place in the entire consciousness.
Some time has passed since we did the pattern walk. I was happy to see some psychedelic participation on that first wave of textures. Since then I have been gathering more and more textures from all over the place, so many that the ones below are just a tiny fraction of the total. The idea of this second wave is to go meta: Now a few of the Inceptionist pictures recently unveiled by Deep Belief Networks are included, as well as several other cool psychedelic replications. The question is… how does a psychedelic replication look like through an actual psychedelic lens? Let’s find out!
You know what to do: If you were planning on taking a psychedelic (dissociative, or God forbid, delirant) hallucinogen, feel free to browse through these pictures and add comments on the salient features you experience from them. To do so click on the pictures that interest you and leave a comment below. Please provide information about the subtance(s) you took, their dosages and how long ago you took them.
What patterns do you see? What stands out? What amazes you?
Special thanks to Mark Gomer, the family of graduates at the 2015 Stanford Psychology Commencement (where I took pictures of cool dress and shirt patterns), and the very diverse and beautiful carpet store right next to Jawbone in San Francisco. Without them, the second wave would have been less diverse and novelty rich.
In this post I will provide an account of my personal research project to understand the algorithms that underly human visual pattern-recognition. This project is multidisciplinary in nature, combining paradigms from three fields: (1) theanalysis and synthesis of textures, (2) psychophysics and (3) psychedelic research. I will explain in detail how these areas can synergistically help us understand the computational properties of consciousness. In the process of doing so I will describe some of the work I have done in this direction.
Textures
Psychophysics
Psychedelics
tl;dr: With texture synthesis algorithms we can control the statistical features present in textures. By using an odd-one-out paradigm where participants have to find the “different texture” we can identify the statistical signatures of the visual patterns people can perceive. Collecting these signatures under various states of consciousness will reveal the information processing limitations of visual experience. It may turn out that some patterns can only be seen on LSD (psilocybin, mescaline, etc.), and this information will inform a general theory of vision’s algorithms, expanding the scope we have studied so far and suggesting relevant applications of psychedelic consciousness.
Introduction to Spatial Patterns
The world is patterned. In fact, it is so patterned, that it is difficult to identify natural surfaces that have no perceptible regularities. The grass, the trunk of trees, the surface of rocky mountains, the dancing and dissolving of the clouds. All of these natural scenes are full of regularities. For hundreds of millions of years animals on this planet have existed in an environment where regularities are not inconsequential: being able to use or detect camouflage is a matter of life or death to some species. The insects who hide between the leaves pretending to be part of the scene are in an evolutionary arms race against predators and their sensory apparatus. (Here is a neat collection of insect camouflage). Arguably, there are strong evolutionary selection pressures that push predator’s visual system into adapting to recognize the differences between the scene’s visual statistics and the prey’s body appearance.
Other widespread examples for the evolutionary relevance of pattern recognition can be found: Birds may take advantage of the look of cloud formations to determine if they should fly or find refuge, herbivores may seek only plants with specific visual properties to avoid poisonous lookalikes and parasites, the health of potential mates can be assessed by the uniformity of their fur patterns. You get the idea.
Not surprisingly, you today can look at a plain rock and see a lot of visual properties pointed out by patterns you can perceive. Unfortunately, something has kept us quiet about this aspect of our perception: most of these properties are hard to verbalize. Often, you will be able to tell apart two kinds of rocks by grasping the subtle visual differences between them, but at the same time still be unable to explain what makes them different.
What exactly is going on in your mind/brain when you are recognizing characteristic features in textures? We don’t know how the information is processed, why we perceive the features we perceive, or even how the various features are put together in a unified (or semi-unified) conscious representation. The hints we do have, however, are precious.
Receptive Fields
A big hint we can build on is that many neurons in the primary visual cortex (of cats, monkeys, and probably all mammals) respond to visual stimuli in specific areas of the visual field. For a given neuron, the shape of this region is an instance of a well-studied canonical function, as shown in the images below. The area of the visual field a neuron best responds to (by becoming excited or inhibited) is called its receptive field, and the canonical function is the Gabor filter.
As far back as the early 60s, research has been conducted to map the receptive fields of neurons by inserting electrodes into the brain of animals and presenting them with visual input of lines and shapes. In 1961 D. H. Hubel and T. N. Wiesel showed for the first time that neurons in a cat’s cortex and lateral geniculate have receptive fields that look like this:
The crosses indicate regions in which stimuli excites the neuron’s activity while the triangles represent regions in which stimuli inhibits the neuron’s activity. Due to the arrangement of these excitatory and inhibitory regions, these neurons functionally work as edge-detectors. A computer rendering of these receptive fields looks like this:
Since then a tremendous amount of research has repeatedly confirmed the existence of such neurons, and also uncovered a large number of more complex receptive fields. Some neurons even respond specifically to abstract concepts and high-level constructs. More recently, the simple receptive fields shown above have been modeled as Gabor filters in quantitative simulations. This, in turn, has been successfully used to build brain activity decoders that reconstruct the image that a person is seeing by assuming that the activity of fMRI’s voxels approximately matches the added activity of neurons with Gabor receptive fields (see:Identifying natural images from human brain activity by Kay, Naselaris, Prenger and Gallant).
Thus we can say that we know that a large number of neurons in our visual cortex have Gabor receptive fields and that the collective activity of these neurons contains enough information to at least approximately reconstruct the image a person is seeing (well enough to identify it from a pool of candidates).
We can’t jump from these findings alone to a global theory of visual processing. That is, without also considering what people actually experience. It may turn out, for example, that the activity of the visual cortex contains a lot of information that can be decoded using machine learning techniques applied to fMRI’s voxel brightness. And yet, simultaneously, it could be that people do not consciously represent all of the {decodable} information.
Likewise, a priori we cannot rule out the possibility that some of the information we consciously experience is not actually decodable using brain activity alone. (A quick remark: this may be the case even if one assumes physicalism. Why this is the case will be explained in a future article).
To illustrate this example we can consider the information available in the retina and before it. The light that reaches the outer surface of our eyes contains all of the information available to our mind/brain to instantiate our visual experience. Yet, there is a lot of information there that is ultimately irrelevant for our conscious experience. For instance, there is infrared and ultraviolet light, as well as light that does not make it to our retina, light that fails to elicit an action potential, and so on. If you can discriminate between a really hot and a cold metal using the infrared signature of the light that reaches the eye, you have certainly not shown that we perceive infrared light or that we use it to make distinctions. It merely means that such information is sufficient. We wouldn’t yet know that we actually use it or that it shapes our experience.
But how exactly do we develop an experiment to infer the statistical properties represented by our experience? Here is where the analysis and synthesis of textures becomes relevant.
Analysis and Synthesis of Textures
The idea of using oriented Gabor-like filters (also known as “steerable pyramids”) to analyze and synthesize visual textures was, as far as I know, first proposed by David J. Heeger and James R. Bergen in “Pyramid-based texture analysis/synthesis.”Texture analysis in this context means the use of algorithms to characterize the properties of textures to capture what makes them unique. In turn, texture synthesis, refers to the application of texture analysis to produce an arbitrarily large patch of a synthesized (synthetic) texture so that the synthetic and original texture are as indistinguishable as possible. Of course whether something is “indistinguishable” or not is to a certain degree subjective. Here the criteria for indistinguishability between the original and the synthetic textures is whether a person comparing them side by side could confuse them. In the following section I address how to operationalize and formalize the indistinguishability between patterns using psychophysics.
This particular texture synthesis algorithm works by forcing a white noise image (of any size) to conform to the statistics obtained in the texture analysis step. This is done iteratively, matching the histograms of the synthesized canvas to the various statistics computed from the original texture. I recommend reading the paper to gain a better grasp of what the algorithm does, and to see some stunning examples of the output of this algorithm.
The use of steerable pyramids was later refined by Portilla & Simoncelli‘s texture synthesis algorithm, which currently plays an important role in my research. This algorithm extends Heeger et al. by including additional statistics to enforce, which are (roughly) computed by measuring the autocorrelation between the various components of the steerable pyramid texture representation. Below you can see two pairs of pictures (two originals and their corresponding same-sized synthetics versions), that I recreated using Potilla & Simoncelli’s matlab code:
Original 1
Synthetic 1
Original 2
Synthetic 2
As you can see, the original and synthetic images are fairly similar to each other. Close inspection is sufficient to notice deadly differences. If you only use your peripheral vision it is very challenging to see major differences.
Psychophysics
Psychophysics is the study of the relationship between physical stimuli and experience (and often behavior). Thanks to psychophysics we now have:
A good approximate map of the phenomenal space of color (CIELAB)
A strong grasp of the nature of color metamers, which in turn underlies all of our color display technologies.
The ability to predict the subjective intensity of the experience elicited by stimuli as a function of the energy of the stimulus (see Weber–Fechner law).
A very powerful idea in psychophysics is the use of just-noticeable differences (JND): Carry a bucket of water. How much water should I add to it so that you are capable of perceiving a difference in the weight of the bucket? Look at a pair of identical light sources. How much blue (in this case, the specific and pure frequency of light that elicits the blue qualia) can I add to one of the lights before you perceive them as being differently colored? Pinch your skin with two needles. How far can their pointy part be before you perceive two needles rather than one?
In these cases, though, there is a natural (and sometimes unique) dimension along which the stimuli can be varied in order to compute the JND. What about visual textures? Here the problem becomes non-trivial. In what way should we change a texture? And how should we accomplish such? There is no clear and obvious scale for describing textures. So what can we do?
Psychophysics of Textures (Take 1):
Before learning about steerable pyramid representations of textures I developed a variety of psychophysical tests to identify the JND between textures. I did this by changing the value of parameters of images with ground-truth statistical properties. If you are curious, feel free to try the first iteration of my experimental paradigm. (Note: I am not collecting data from that experiment, so you should not expect to contribute to science by finishing the task. That said, you can have fun, and a pop-up window with your raw score will appear when you finish both tasks). The average accuracy of the texture discrimination part is about 13/21 (with a chance performance of 3/21), while the performance in the numerical pattern completion task is about 3/5 (with a near 0/5 expected performance when answering randomly).
One of the statistical properties I was changing in the stimuli was the variance of a 2D Gaussian process I implemented with a python script and the magic of Gibbs sampling. Thus, a subset of the images I tested were complete noise except for the first order statistic of local autocorrelation created by the differently parametrized Gaussian process. Here are a couple of examples of such patterns:
These pictures, it turns out, are relatively easy to tell apart when the parameters are sufficiently different. There is a threshold of similarity in the variance parameter after which people cannot distinguish between them. A nice property of this particular method is that you can be sure that if people do recognize the differences, it is because they are somehow extracting features that are a direct consequence of a different value for the variance parameter.
The textures above instantiate the simplest statistical differences that can be created, after the mean and standard deviation of the pixel values. To explore more broadly a wider variety of patterns, I also created textures with fairly complex parametrizable Turing machines (TMs). This, unfortunately, does not lend itself to a clear analysis. In brief, this is because changing a single parameter of such TMs can produce profoundly different results with unclear ground-truth properties:
What information could I gain from the fact that changing x, y or z parameter in a Turing machine by a, b, or c amounts enables accurate discrimination between textures? In principle one could try to explain the performance obtained by making an a posteriori analysis of the correlation between a variety of statistics measured in the textures. But since the textures were not created to have specific statistical properties, the distribution of such properties will not be ideal to find JNDs or discriminability thresholds.
Even if you do this, you will still have more problems. The images are more different (and different in more ways) than what your texture analysis algorithm is capable of detecting. Thus the reason why people can tell these textures apart is not possible to extract from the statistical differences you measure between them. At least not without being extremely lucky and hitting the visual features that matter.
And here, I was stuck several months.
Psychophysics of Textures (Take 2):
After learning about the steerable pyramid model, the work of Eero Simoncelli and the state of the art in fMRI decoding of visual experience, I decided to shift gears and approach the problem with some of the best of the tools created so far.
It turns out that the concept of texture metamers had been developed to describe the perceptual indistinguishability between textures in peripheral vision. Taken from here, the following two images are texture metamers. The images look the same when you center your vision in either of the central red dots. Close foveal inspection of the image, however, will reveal that these are very different pictures!
A specific study caught my attention, and I decided to replicate it as a final class project. Specifically, Texture synthesis and perception:Using computational models to study texture representations in the human visual system by Benjamin J. Balas. I attempted to replicate some of the main results of that study using Mechanical Turk. A full account of the experimental procedure, results and discussion can be found in this wiki here, (written for Stanford’s Psych 221 – Applied Vision Systems). To see the actual experiment performed, try it out here: Replication (and the github repository).
The main idea goes as follows: If textural metamerism can be verified using a given texture synthesis algorithm, then we can be reasonably certain that the algorithm is capturing a large component of what makes textures different from a human point of view. In particular, Benjamin Balas noted that Prtilla & Simoncelli’s algorithm could be “lesioned” by failing to enforce specific statistical features obtained in the texture analysis step. In this way, one can purposefully fail to match specific statistical features between the original and synthesized texture, and then measure how this partial texture synthesis algorithm affects the performance of texture discrimination in humans.
For illustration, here is a set of possible texture synthesis “lesions:”
Original
Full Set (complete algorithm)
Local Phase removed
Magnitude Correlation removed
Marginals removed
Subband Correlation removed
The operationalization of the experiment used an “odd one out” paradigm: in each trial, three images are presented for 250 milliseconds at 3.5 degrees of vision from the fovea (each image being 2 degree wide in diameter). Two of the three images will come from the same group (ex. two original textures, two marginals removed, etc.). The remaining image is the odd one out. The study measures how often participants detect the odd one out depending on the statistical feature that is not enforced in the synthesized textures (for a more in-depth description: wiki).
Overall the performance of the participants in my replication was much closer to chance than Balas’ results. That siad, qualitatively the replication was successful. Removing the marginals is the lesion that increases performance the most. Magnitude correlation comes in second place. All of the other conditions are at chance level (as far as my sample n=60 with 60 trials each can discern).
As you can see, this specific paradigm is now much more robust than before. And the paradigm is not hard to translate for application in psychedelic research. Unfortunately, Portilla & Simoncelli’s algorithm only creates texture metamers for the peripheral vision in pre-attentive conditions. Upon central inspection, nearly every synthesized texture is at least somewhat distinguishable from the original texture.
The more interesting problem, as I see it, is found in our capacity to see differences between textures upon close and careful examination. This, I think, addresses more directly the subject of this blog. Namely, what is the information that we can represent and distinguish at the (resolution) peak of human consciousness? I imagine that there must be statistical features that we simply do not perceive even when we are looking at them directly and using all of our attention. What is the set of properties that our everyday consciousness can represent centrally?
Psychedelic Research
To understand how a machine works, it helps to know what happens when you break it. You can’t ignore the extra settings and claim you’ve got a theory of everything. Would we be satisfied with the work of neuroscientists and psychologists if they only studied people who are colorblind? They may claim that they have “the essentials” of vision. That color is just a perturbation in the “optimal basics.” And yet, today we know that color plays a relevant computational role in visual discrimination. Suffices to mention that people with grapheme-color synesthesia have an improved performance in “odd one out” identification tests like this (find all the 2’s as fast as possible):
This is because fast low-level association between graphemes and colors help them see clearly and quickly the graphemes that are different. Likewise, every variety of conscious experience may potentially play a computationally relevant role in specific situations. A priori, no variety of consciousness can be dismissed as irrelevant.
Thus, to understand, model and engineer consciousness, we should not prematurely close varieties of consciousness to study. Not only would that prevent us from finding out about consciousness more generally. It may also conspire that we will never understand even what we do decide to study, simply because key pieces of the puzzle are found elsewhere.
Another point is that even though sober human vision is a special case of general vision (and general vision-like qualia), general vision may still be relatively small. The general principles and conditions for vision to work in the first place may be somewhat restricted. Unless the elements are placed just right, the visual system breaks down, at least when it comes to fulfilling a computationally meaningful purpose. Thus, psychedelic research of visual experience may help us quickly distinguish what is essential from what is incidental in vision.
By introducing a psychedelic substance into the nervous system of a person, a remarkable set of visual effects are produced. To anyone interested in seeing a good representation of the way in which various psychedelics affect a person’s conscious experience I highly recommend seeing Disregard Everything I Say’s entry on the visual components of a psychedelic experience (while you are at it, I recommend also checking out his/her post on the corresponding cognitive components of a psychedelic experience). These images will provide a great intuition pump about the kind of beast we are facing to anyone who is psychedelic-drug-naïve (and hopefully inspire a sense of “WOW, you can represent some of what you experience after all!” in those who are less psychedelic-drug-naïve).
Given the same visual input presented to a particular person, a psychedelic substance will in many cases drastically shift the interpretation of such stimuli. Both the interpretation (specifically, what an image is about) and how the image looks and feels tend to vary in synchrony. Likewise, people feel more able to see personal issues in a new light by interpreting them with new schemas and from a different level of awareness. Personally, I suspect that there is a strong and measurable connection between the fluidity of interpretation of personal issues, and the fluidity of interpretation of visual experience. Perhaps all phenomenal constructs are affected in a similar way: By breaking down the previously enforced patterns of thought and perception and opening the way to seeing things differently.
All of the above, while probably true, is still far too vague for a scientific theory. Given our set of tools, and experimental paradigms, to me it makes a lot of sense to start studying the effects of psychedelics in terms of texture perception. As we develop more and better texture analysis/synthesis algorithms, we will acquire a larger repertoire of mathematical properties that describe what is seen during a psychedelic experience. My hope is that we will someday know exactly how to simulate a visual trip.
Why care about psychedelics? Evolution already created the optimal vision system!
Evolutionary selection pressures on perceptual systems do not guarantee that information processing tasks will be solved optimally. In fact, “optimal” only really makes sense in relation to some metric you choose. In some way, everything created by the evolutionary process will be optimal in the sense that is produces the local maximization of inclusive fitness (admittedly it’s more complicated than that). But this is just a tautological notion: Sure evolution is optimal at doing what evolution does. Likewise, rocks have found the optimal way to be themselves. Our visual system works optimally, if you define optimal in terms of 20/20 every-day visual experience.
Instead, it makes more sense if we focus on the specific computational trade-offs that various resource allocation methods and designs provide. We can certainly predict that the particular set of algorithms that our visual system employs to detect visual patterns will satisfy some properties. For instance, they will be good as survival tools in the African Savanna. But just as for our hardwired tastes in food (and our default emotional palette), survival value in the ancestral environment is not necessarily what we currently need or want. And just as it would make sense to modify what we enjoy eating the most (moving away from sugar) to adapt to the current post-industrial environment, it may also turn out to be the case that our visual system is miscalibrated for the tasks we want to solve, and the joys and meaning we would like to experience today.
Psychedelics change our visual system in many ways, some of them more predictable than others. Some people report that small doses of psychedelics increase one’s overall visual acuity (this has yet to be verified empirically). Although counter-intuitive at first, this cannot be ruled out, again, simply because of evolution does not rule out things of this nature. After all, one of the main constraints placed on animals in natural environments is caloric consumption. If a higher visual acuity is possible with your current brain, the marginal benefit such acuity adds may still not surpass the marginal loss of calories that result from excessive brain activity.
Additionally, while higher doses of psychedelics tend to impair many aspects of visual perception (with people on Erowid explaining how extreme tracers can make it hard to walk), low and moderate doses do not have simple one-sided effects even when it comes to accurately representing the world around us. Rather than simply breaking up the pattern recognition capabilities of the visual system, small and moderate doses seem to also open up additional kinds of patterns up for inspection. Pareidolia, for example, is greatly enhanced. Thus, “connecting dots and edges” to match the outline of higher-level phenomenologies (like faces in the mud) happens with ease. Whether this is good or bad depends on the context, and the specific task one is trying to solve.
Perceptual Enhancement via Psychedelics
We have theoretical and anecdotal reasons to suspect psychedelics may turn out to be performance-enhancing in certain visual tasks. We also already have quantitative evidence that this is the case. In the 60s Harman and Fadiman conducted a study about the creativity and problem-solving properties of psychedelics. The study included a paper and pencil component in which the following tests were administered: Purdue Creativity, the Miller Object Visualization, and the Witkin Embedded Figures. The authors conclude that “[m]ost apparent were enhanced abilities to recognize patterns, to minimize and isolate visual distractions, and to maintain visual memory in spite of confusing changes of form and color.” Specifically, the Witkin test is singled as a test in which the ingestion of mescaline produced a consistent performance improvement (p<0.01).
Example of a Witkin Embedded Figure. You have to determine if the left shape is in the right figure within 30 seconds.
In personal communication Fadiman has said that these tests were mostly a waste of time: They used one valuable hour of the problem-solving session. I disagree. After 50 years, those results are incredibly valuable to me and the next wave of computational researchers of the mind. I think that the recorded performance enhancement is a key piece of information. We certainly do not expect an enhancement on all areas of cognition and perception (we know, for example, that reaction time and verbal fluency are impaired). Identifying the kinds of tasks that do receive a boost can inform future research. In future posts I will explain my theory for why Witkin Embedded Figures test was particularly benefited from a psychedelic, and how we can create a new test that takes this into account.
New Possible Protocols for Psychedelic Research
Nowadays it is very hard to obtain the required permits and affiliations to conduct academic research on psychedelic consciousness. The key rate-limiting factor is the restrictions that apply to research with controlled substances. Thankfully, we do happen to be living at the beginning of a psychedelic renaissance. It is not hard to imagine that as psychedelics start to (re-)enter the mainstream in psychiatry, a large number of clinical trials will be conducted. In principle, a collaboration can be accorded between a psychophysics lab and a clinical research group to conduct psychophysical assessments during the course of treatment.
Clinical trials for medical applications of psychedelics, though, are still limited in scope and focus. Eventually the medical applications of psychedelics will run out and it will no longer be possible to enroll patients into psychophysical studies. Thus, either more permissive rules and regulations will emerge and society’s rules will be more lax, or we will potentially endure decades or centuries of unnecessary barriers to scientific discoveries about consciousness.
As it turns out, tens (if not hundreds) of millions of persons have tried psychedelic substances. Interest is not slowing down, and no propaganda effort save for literal brain-washing will prevent people from developing a genuine interest in the field. There will be millions of volunteers and hundreds of thousands of willing researchers. As I envision in The Psychedelic Future of Consciousness, the future of consciousness studies will be nothing like what it is today. Once those who are interested are given the opportunity to study psychedelics seriously, the research panorama will look very differently.
But What to Do in the Meantime?
Investigating the psychophysics of texture perception more thoroughly may require at least mild to moderate doses for noticeable effects, and a period of examination at a time when acute effects are present. How to overcome the hurdles ahead of any current academic investigation of this nature? This ultimately depends on the specific constraints required for the study. It is true that people would have to be high on LSD (or Mescaline, mushrooms, 2C-B, etc.) while they perform the experiment. But who says that they have to conduct the experiment in your presence? That you have to give them the substance yourself? Without the typical background assumptions that are assumed in psychophysics research labs, can we do anything else?
I suspect that we can do much better. We can come up with protocols that side-step current obstacles. We need to be creative. And I do have some ideas, with varying levels of plausibility for how to implement psychedelic research in legal, viable and immediate ways. Consider, for example, how James Fadiman has been collecting hundreds of micro-dose reports via email without any difficulty for many years. He is taking advantage of the fact that the optimal format of micro-dose reports tends to be “summary and retrospective” narrative. A single dose on a single day on a single person is not likely to be life-changing. So his particular line of research is well suited for the means available to him. Likewise, as I requested in the psychedelic experience of visual textures post, people’s subjective judgements of visual textures while high on LSD can be recorded online. These are just two examples of how non-mainstream research approaches can be taken to study psychedelics. Unfortunately, both of these protocols lack proper controls and standardized settings. But this is all I will say for now.
Stay tuned: In a future post I will propose a set of protocols for independent studies on psychedelics, including additional methods for studying psychedelic visuals.
Thanks for reading!
If you would like to be a collaborator with me, please email me by finding my contact info in the contact section of this blog. We’ll take it from there.
Note: If any link is broken, please leave a comment and I’ll provide an updated version. Thanks!
On March 24th 2015 Team Qualia Reverse Engineering (TQRE) went for a long walk within the Stanford campus and around Palo Alto. The purpose of this walk- the Pattern Walk -was to snap a picture of every interesting pattern (or texture) out there that got on our way. The following gallery contains 74 of these patterns. These display a wide range of texture properties: Natural/synthetic, regular/irregular, 2D/2.5D/3D, symmetric/asymmetric, structured/unstructured, etc.
Here are a few observations:
Human languages do not have the necessary vocabulary (and conceptual primitives) to talk about visual textures adequately. When two images belong to the same category (say, “plants” vs. “rock tilings”), and have roughly similar first order statistics (mean, standard deviation, kurtosis, etc. of the RGB values) there is relatively little else to say about a texture in a way that a person would understand.
Our visual system can recognize extraordinarily subtle properties that distinguish textures from one another. For instance, I bet you can recognize at an immediate experiential level the differences between picture 61 and 62. But can you verbalize such difference?
Mathematics, and statistics in particular, may provide helpful semantic seeds for describing patterns. Indeed, having a basic handle on a few mathematical concepts can leverage one’s ability to talk about the differences between textures. For example, compare images 43 and 44. They are perceptually very different. But how long would it take you to convey the difference to a random person? If there was a person who could only hear you, how would you signal that you are not talking about 43 but 44? If both of you know of the concept of concavity you might only need a few words! Without it, you’d be fairly lost.
Fancifully, we may someday produce a good vocabulary that can effectively allow us to talk about visual textures without having to be currently sharing the same (similar) visual experience.
In practice, we already have some vocabulary that accomplishes this, but it is very obscure and sufficiently technical that its widespread adoption is unrealistic. In particular, I encourage anyone interested in the topic to read “A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients” by Javier Portilla and Eero P. Simoncelli. They analyze (and synthesize) visual textures by computing a set of highly descriptive statistical properties characteristic of the pattern in question.
As we will see in future posts, their model can be used to point out perceptible statistical features that are perceived as regularities by the human visual system. It may not be sexy to say “Hey Ma’m I really dig the Cross-scale phase statistics of the pattern in your dress.” For now, that’s what we have.
If you want to help me figure out how psychedelics affect your visual experience:
Please browse through these images by clicking on the first one and exploring the slideshow. See which images you like, which produce “odd or interesting visual effects” and which “stand out” in however way you want to define that. Feel free to comment right below any of the images (there is a comment section beneath each image when you click through them as a slideshow) to point out the peculiarities that you notice.
Critically, also include your state of consciousness in the comment. If you took LSD (or any visually-affecting substance) two hours ago (or you are still high), it would be great if you could point that out. Please explain how you think that your visuals are affecting your experience of the various patterns. Everyone loves to talk about their LSD visuals. Now you can do it all you want! And your efforts may actually enable us to understand the way psychedelics affect the algorithms of human vision 🙂
The best case scenario:
You would make comments on these images while sober, and then add comments while high on a psychedelic (doesn’t have to by psychedelic – could be dissociative, though typing might be particularly hard in that condition). Point out the main differences between the textures as perceived on each of the states of consciousness you happen to be in. If you do decide to follow the above protocol, please provide information about the specific substance(s) you consumed and how long ago you did so.
That is, do this if you were planning on taking a hallucinogen to begin with. Independently of that, baseline data is still very valuable, so do add comments about these patterns even if you are sober and plan on staying sober 🙂
In the following post I will explain how this Pattern Walk, the statistical analysis of visual textures, psychophysics and psychedelics can ultimately fit into the larger project of reverse-engineering the computational properties of consciousness.
