Required reading before this article: An Introduction to Reality
In everyday life we assume that our Experience is laid out as a simple transfer of information from each retina to create a copy of the features of the world around us. This is not the case. Our Experience is carefully arranged by our brain so that it is laid out like a painting on a canvas. We can see this in the following visual illusion (The Waterfall Effect). Stare at the dot in the centre of the moving image below for a half minute then at the pattern below:
Notice that the pattern appears to flow slightly inwards. This shows that the contents of Experience can be rearranged fairly rapidly by our brains. In normal life it is rearranged to overlay the projected positions of objects in the world around us. Another interesting aspect of this illusion is that content is being placed on a fixed background that does not move which suggests that our Experience is like a canvas on which events are drawn.
Also notice that when our gaze moves to the lower pattern the frame of the lower pattern shrinks slightly and stays smaller than the frame above while the contraction effect is operating. There appears to be a continuous inward flow of the lower pattern but on close inspection the flow is a series of contraction-like events that are around a half to one second long.
We can also experience the fixed background by spinning round and round. When we stop spinning our visual image briefly continues to rotate but this moving image occurs on a fixed background or "frame of reference". Somewhere there is a fixed grid, a steady set of physical things that receives the data we experience. The data changes but the frame of reference, the grid, is constant. Sounds do not spin with the visual image, maintaining their position in the fixed reference frame within which the model of the body and vision spins.
When we glance from place to place in the view our eyes move over a constant image even though the images on our retinas are changing wildly. When we move our heads the whole image changes. Our view is like an image on the inside of a large sphere that has our head inside it. If we walk in a straight line the image maintains its orientation, being stable in the direction of our motion even if we move our heads to look to the side.
If we spin round and round with our eyes and heads fixed in position relative to the body and attempt to walk forward the image becomes unstable and it is difficult to maintain balance. This is an amusing party trick for the young.
The view is displayed so that it is centred on our direction of motion. When we are stationary the centre of the view is set by the position of our head. Our vision is a sphere of events that can be inspected with eye movements and wholly rotated by body and head movements.
When the visual sphere is being rotated it seems to move against a deeper, fixed background.
If we spin round and round the position of a loudly ticking clock will remain fairly constant even when we stop and our visual sphere is still spinning. Sounds, sights and other sensations have differently managed contents that seem to be projected as different layers. There is even a layer that contains a crude map of our surroundings. A more appropriate term than "layers" is "Nets" which emphasises the looseness of the interpenetration.
Most nets correspond to a type of sensation. Some nets, such as that which displays sound, stretch right around our heads and bodies. Vision is an exception because it includes events from in front of us but not from behind us. This results in the visual field seeming to slide over the other nets.
If we are blindfolded and rotated in a quiet room we lose track of the location of doors and chairs etc. A remaining source of position data is the space where our arms and legs can move, this is closely based on our body image and the net for body position survives most manipulations.
Provided we are not stressing the system by deliberately rotating our bodies etc. the various nets that contain events in the world are aligned so that we can reach out to pick up a ticking clock and see it in its proper place. The spherical nets are separate but interpenetrate each other.
Contents are being placed in our Experience all the time but what are these contents? Different places in our Experience have different qualities. In some places there are blue patches, in others grey zones with sounds attached and so on. There is a type of quality for each sense, such as smell, touch, sight etc. Qualities are the various contents of our Experience.
Qualities occupy space and last for a period of time. If something has no extent or exists for no time at all it is not possible to have it in our Experience. Qualities exist because they have an extent and a duration.
Notice that the different types of quality can overlie each other at a particular patch in Experience. We hear the sounds of words coming from the red lips of a speaker so that sound overlies vision but does not replace it. Within each type of quality there are individual qualities such as a particular red or the sound “middle C”, each of these is called a “quale”. Each small dot of visual Experience seems to host a quale of colour, intensity, edge etc. within its own time extension. Colour, intensity, pitch etc are types of quale. Individual types of quale replace each other so that, for instance, lips cannot be red and also blue at the same place.
It is tempting to imagine that these qualities, these events in our Experience, are simple material objects that are illuminated by some inner light. Lets take a closer look.
The illustration above is an “Auto-stereogram”. If you look at it with your eyes relaxed so that you are looking into the distance, with your eyes focussed beyond the image, you can see a “3D” image of a loop around two eyes and a mouth (all crudely rendered like a smiley face).
If you cannot see the loop try lying straight out on your back and holding this page up at the level of your waist then adjust your toes so they are just above the image. Look at the image and try to focus your eyes at the same time on your toes. The “3D” image should appear as a loop that floats above the surface of the page. If you have not seen an autostereogram before it is worth the effort of adjusting your eyes to see it. A smiley face floating in a sort of clear aquarium on the page is uncanny.
Having seen the “3D” we can move our heads from side to side and notice that the background moves faster than the smiley face. We can also see that the “3D” image is crisper and brighter than the 2D pattern from which it is derived – being synthesised and directly in our brains.
Once you are able to see the “3D” image, try covering the right hand quarter of the image on the page with a finger held midway between your eyes and the image. Notice that part of the “3D” face disappears. Auto-stereograms need information from large areas of the physical image to create the floating image in our Experience. Everything we see, hear, touch etc. is much more than a simple thing. As the hippies used to say “its all connected”. It is interesting that when you place your finger between the image and your eyes the “3D” nature of the image disappears beneath the transparent image of your finger showing that the finger is covering a crucial part of the “3D” image in one eye and this is what makes the “3D” nature of the image disappear.
The image containing the autostereogram in our Experience seems to be divided into two planes composed of the background and the smiley face at different distances in front of our observation point and not at the same distance as the surrounding page. We know that the image on the actual page is flat so the autostereogram is yet more evidence that our Experience is a model in our brains.
The “3D” image is in our brain, the image views itself and the separation between the viewing point and the image is probably a separation in time.
This is a very important point: our Experience is the end of the line, where the data from our senses stops. The bit of brain that contains this data extends in time and so “views” itself. See the Appendix.
Types of quality are like separate nets of events, they are complicated spaces containing events that overlay and are weakly connected to each other. The term "net" is used because, as we saw with the autostereogram, each patch or dot is composed of contributions from all over the space. Each dot is an octopus drawing in its surroundings.
There are separate nets for sound, vision, smell, touch, kinesthetic, somesthetic and taste sensation etc. Imagination can weakly populate these nets and sensation strongly populates them.
Notice that sensory qualities are never at a point in our Experience – they are always spread over a patch – and they cannot occur for no time at all – they are always extended in time. Sensory qualities are composed of events in a whole zone of each network. Qualities are not simple physical phenomena but zones of events in a net and between nets that are brought together.
How are these different types of quality that reside in their own spaces, or nets, brought together?
We have already noticed that our observation point is simultaneously connected to the contents of our Experience. In the same way each dot in our Experience is connected to the content of the nets around it.
Its all connected and all the connections are connected as the observation point brings together all the connected patches in each net.
Green, red, middle C, a pain in your finger etc. are complex, they seem to be one, simple thing but they are actually many things at each dot in Experience. But what is it like to have many things at every small dot in our Experience? Look at a violinist from a distance, we hear and see many things where the musician's bow touches the instrument. Think of the sound, sight, movement pattern and tiny puff of rosin around the violin.
Memory also affects qualities. It does this in two ways, the first is Direct Memory where the events in experience are coloured or formed with parts derived from memory. We have already covered "saccades" which show that most of our Experience is internal. Experience is updated in small sections so most of Experience has not been updated in the last second or so and is composed of very recent Direct Memories. If we are experiencing familiar objects we may also populate our Experience with qualities linking to much older, prior events. As an example, we might assume that a familiar face has a moustache and see the face with a moustache even though its owner shaved off the moustache yesterday. The memory is still direct because we look straight into it.
The second way that memory affects qualities is through Recalled Memory. As an example the sight and form of the guitar has the potential to evoke weak views containing its associations that can overlay the original. The kaleidoscope of associations evoked by an object appear to be accessed from the observation point because. even if these associations are realised as recalled words or images, the associations are in a view based on the observation point.
Some memories, for instance those of a guitarist playing a malaguena on a cool evening in a Spanish church, are not directly attached to the things we are sensing now. These memories seem to have a place of their own in our Experience. Where are these memories in our Experience? As we are listening to a piece of music we may recall a phrase whilst the music is happening, if we are not very musical the phrase may be sung “la la la di, la la la di..” or if we are musical we may imagine the sound of the instruments. The recalled sounds are overlaid on the sensed sounds near to our heads, like an interposed layer. This is similar to the way that each type of sensation overlays Experience. Memories and imaginings can have their own nets.
Each type of quality, such as a sound, sight, smell etc, is only weakly linked to other types of quality. For example, sound and colour are linked in the sense that the sound of speech comes from the red lips of a speaker but the link is not obligatory because we can easily wrongly position sounds or have sounds without any visible source such as a bird tweeting behind the foliage of a tree. Each type of quality has its own arrangement in space that overlaps that of the other types so that, for instance, the arrangement of auditory events is not perfectly linked to the arrangement of visual events. We can see this imperfect linkage when we lift our hand to obscure the image of a guitarist and the music from the guitar continues uninterrupted. The various types of quality are distinguished by being transparent to one another. In the case of sound and vision the transparency is perfect, for instance we can arrange stereo speakers so that the sound stage of the music is heard as if it comes unimpeded from behind a wall.
The time extension of qualities varies between types of quality. About half a second to a second of sound exists in our Experience but this can be divided into several different qualia, for instance a whole bar of a tune can be in Experience but it might be composed of four different notes.
Visual Experience extends less than a tenth of a second. When we visually track a moving object it is both the short time extension of the visual object plus the time extension of other types of quality that give the visual object motion. The short duration of the visual object at each point in its path is hosted in the longer durations of the time extension of eye muscle movement etc.
But what are these qualities in themselves, what sort of physical event is a quality? Blue exists in space and time. There is no blue that exists for no time and no blue that occupies no space. Blue is a four dimensional object. Blue and other colours are popping into and out of Experience as whole objects. The colour of an object in our view seems specific to that object but on closer inspection each “material” object is composed of contributions from related things. As an example, when we first hear the tweet of a bird the sound is not as clear and complete as when we recognise on the second tweet that it is a blackbird. Sounds carry with them various relations to their source and colours have relations such as where they have been seen before. Every part of the view shares the ability to be a place where the relations of that part of the view are brought together. When we have blue in our view each dot of the blue is a connection to its relations. The blue in Experience is a matrix of connections that are connected to each other at the place in Experience where it occurs. At the far end of the connections there are real materials distributed in space and time that, when brought together are merged into a new entity, a Quale.
The quale probably uses the same physics as that which creates the observation point to create connections out there, in the model that is Experience.
When we do eventually discover the physical events that create blue in our Experience these events will only be blue if they are slotted into that Experience. Obviously descriptions of these events will not be blue, only the conjoined events are blue. In the case of blue, as for any quale, there are physical events somewhere in the brain that are connected to it. If we had never experienced blue but had the capacity in our brain to generate a blue quale it is not impossible that we could have dreams containing blue.
What we do know is that the layout of qualia in sensory Experience can be very similar to the layout of the things in the world that create this sensory Experience. This strongly implies that it is the early parts of the sensory pathways such as the Lateral Geniculate Nucleus of the Thalamus or Superior Colliculus etc. that supplies much of the qualia. Our Experience has a haziness until we focus on particular objects and this suggests that the core of Experience is of low definition in a part of the brain that crudely integrates sensation but extends to contain the content of other areas of the brain. The multilayered nature of Experience, with overlaid nets of qualia, would also suggest a low definition conscious part that can connect to other areas of the brain. Experience is like opening windows to more distant parts of the brain.Each type of sensation, such as touch, hearing, taste etc. has a separate net on which it is displayed with qualia in each net being heavily interconnected. The nets overlie and relatively weakly, connect with each other.
Look around and focus on a colour. The patch of colour is a connection into its relations which extend from the sensory input at the eye to other experiences containing that colour. Every patch spreads out to its relations. The extension in time that lets us know these relations is discussed in chapter 4.
Experience is patterns of activity that are either passing over or creating nets. Does the Experience exist in the activity or in the nets? If the nets are solely composed of the patterns of activity, and created by that activity, then they should disappear when the activity disappears. The difference between Experience being in the pattern of activity or in activated nets is similar to the difference between a cinema screen and a computer screen. Cinema screens are passive with an image passing over them whereas modern "LED" computer screens actively change colour to create the image.
If you wear a blindfold in a darkened room the visual net contains black qualia. There is still a visual space despite the absence of input to visual experience. A similar space and time composes the other sensory and mental nets. If the visual net can be solely black qualia this would imply that Experience is embedded in material objects such as cells or parts of cells even when there is no obvious activity. Experience would be a property of the nets and not solely of the activity passing over them.
An important consequence of the existence of the nets even when they have no data is that it is possible that they are substantial, material things inside our brains such as the membranes of, or protein strands within, brain cells rather than the electrical impulses that feed data into the nets.
If we rotate our heads from one view to another we can experience the whole visual net being re-loaded with data every time we stop. The fine detail takes about half a second to be loaded. We do not seem to reload some of the other nets such as those that contain sound and the general mapping of our location. The sound and mapping nets extend right around our heads so do not need to be updated as our head moves whereas the visual net is forward facing and needs to be updated as its contents change. The visual net aligns with the part of the sound and map nets that correspond to where our heads are pointed in the world. This allows long time extensions to exist in the sound net as the qualia for each sound stay at the same place in their net.
The short time extension of the parts of the visual image (less than a tenth of a second) means that moving objects can be rapidly re-drawn in the view. This short time extension also allows the fairly accurate positioning of moving objects.
Moving sounds, such as a bird cawing as it flies, are dealt with like the change in the visual image when our head is rotated, they are entirely re-displayed as rapidly as possible at a different position in the sound net. The relatively long time extension of sounds means that we have poor accuracy for locating moving sounds compared with the location of moving images.
Objects in Experience are collections of qualities and the most immediate attribute of any quality is usually it’s position. Position is also the most important attribute of whole objects. Green grass belongs on lawns and meadows which belong on the ground. Experience is objects within objects within objects. Each quale belongs in an object (a collection of qualities) and each object is contained in other objects. However, as was discussed above, each quale such as the particular black of this letter “T” is connected to where it appears so it is a particular “T” black on a page of text. Experience is objects within objects within objects and in the opposite direction connections to objects that connect to objects etc. Each small patch that we call a quale is actually a central node in a web of connections.
We tend to put groups of qualia together so the letters “T” and “A” both contain input from areas on our retinas that are relatively scarcely stimulated by light and can be described as black. We call this the colour black but we should really call it retinal black to make it clear that “T” contains retinal black as part of “T” black. The black qualia on the “T” connect to all the positional and other connections of the “T”.
Experience is the container of all our current objects. The central node of Experience is our observation point which is connected to all of the qualia in Experience simultaneously. This means that Experience is similar to a single quale in its origin.
A quale cannot exist for no time at all so each quale is a time extended object. Each Quale that is out there in Experience is connected to itself through time.
The connection at the observation point is between the quale and the rest of Experience. This is a very important distinction: a quale out there in experience contains points that connect to its relations and its previous state whereas the observation point interconnects various qualia at different places in Experience across space and time.
This gives us an insight into the nature of the observation point. How can many things be at a point? They cannot flow into the point because they would jam it up and in the case of our observation point we do not have any observation containing flow from things out there, in Experience, into the observation point. Nothing flows yet everything in Experience is simultaneous at the observation point. The only obvious alternative to flow is the idea that space disappears between the observation point and the contents of Experience.
We know the content of Experience is in our brains so nothing that we have in Experience can in reality be more than a few centimetres from any observation point yet because the content is a projection from a point we regard our Experience as having the scale of the world around us. That scaling would stay intact even if Experience were a centimetre or a millimetre or effectively no distance at all from the observation point. The observation point is most likely no distance at all from the content of Experience.
The experience containing light or sound has two components, the apparent emitter of the sound or light (apparent because nothing is emitted) and the connection of this quale at the observation point to the rest of experience. The apparent transmission of light or sound is what the connection between a quale and the rest of experience is like.
The connections should be construed as the disappearance of space and time between the components rather than as a movement of the components.
Suppose the object is a tiny black dot on a perfectly white dome that is modelled in Experience. The dot is connected at the observation point to every part of the dome. The parts of Experience that are not the dot are connected to the dot as something elsewhere because there are no self connections for the black dot in the white parts of the dome. Self connections at the location of an object in Experience comprise the object and connections at the observation point are what we call space and time in Experience. There will be much more about time in experience in subsequent chapters.
Look through one eye. Our vision is qualia arranged radially around a point. The qualia could be near or far from the point but their arrangement will stay the same. Space could disappear between the observation point and the qualia but the arrangement would stay the same.
We observe no flow into the observation point so the most likely explanation is that there is no space beween the observation point and the qualia that surround it. Such a possibility sounds absurd but it is not impossible according to physics. Relativistic length contraction is a disappearance of space so if qualia were electromagnetic in origin the disappearance of separation might not be impossible, similarly the instantaneous connection of entangled particles is suggestive. Of course neither of these may be the source of the observation point but we should not let a passion for nineteenth century physics blind us to the possibility of physical explanations.
A quale is where arrangements in time and space are brought together at a dot out there in our view. No material actually moves into this dot because, in the same way as nothing moves into our observation point, the quale is a connection point that marks where objects are no distance in space and time from each other.
Sit or lie comfortably. What we see is in our brains. It is a model based on the world outside. This model is our Experience. Look at the colours of the things around you. They are in Experience.
If you close your eyes and gently press your eyeball through your eyelid for thirty seconds you can see little coloured dots and patches without the need for external light (these colours are called phosphenes) so the particles of light, the photons, that strike your open eye are just triggering the first step in our colour producing mechanism, photons are not colours in themselves.
In the world outside of Experience a flow of light illuminated the objects but that flow is not happening in Experience. A blue quale is a blue quale, not a frequency of reflected electromagnetic radiation out there in the world. In our Experience the “light” is the quale that is the colour and is not something reflected from an object. The blue is the quale. The apparent light is the blue that is the quale.
Look at this page through one eye. The distance between this line and ten lines above is an angular separation at your eye. The distance between this line and five lines above is half of that angular separation. Both of these angles are actually in your Experience, in the model in your brain.
Listen to a sound. The sound is in Experience, at its place in Experience, not emitted from that place. Listen to inner speech. Our thoughts are arranged in Experience. We only have our thoughts when they appear in Experience. Our Experience is like a space and time with qualia arranged within it. All our current experience is in Experience.
The observation point is just a point, there is nothing that we can experience within it. All that we can currently experience is in Experience.
Touch your head briefly. Before you moved your hand the touching of your head was in your future. After you touched your head the touch was in the past. All of the events that will affect you are in your future and almost all of the events that are affecting you now were in your future. This is obvious but we like to think that when a bat hits a ball the past has determined what happens but it is the future strike of the ball on our body that determines the bruise. The past does not create today, the future does, the past is always gone.
Copyright © 2007 Free Software Foundation, Inc. <https://fsf.org/> Everyone is permitted to copy and distribute verbatim copies of this license document, but changing it is not allowed