What is consciousness?
To identify sentience, consciousness, or even intelligence, we’re going to have to work out what they are. The debate over these questions has been going on for centuries.
The fundamental difficulty in understanding the relationship between physical phenomena and our mental representation of those phenomena. This is what Australian philosopher David Chalmers has called the “hard problem” of consciousness.
There is no consensus on how, if at all, consciousness can arise from physical systems.
One common view is called physicalize: the idea that consciousness is a purely physical phenomenon. If this is the case, there is no reason why a machine with the right programming could not possess a human-like mind.
Mary’s room
Australian philosopher Frank Jackson challenged the physicality view in 1982 with a famous thought experiment called the knowledge argument.
The experiment imagines a color scientist named Mary, who has never actually seen color. She lives in a specially constructed black-and-white room and experiences the outside world via a black-and-white television.
Mary watches lectures and reads textbooks and comes to know everything there is to know about colors. She knows sunsets are caused by different wavelengths of light scattered by particles in the atmosphere, she knows tomatoes are red and peas are green because of the wavelengths of light they reflect light, and so on.
So, Jackson asked what will happen if Mary is released from the black-and-white room? Specifically, when she sees color for the first time, does she learn anything new? Jackson believed she did.
Beyond physical properties
This thought experiment separates our knowledge of color from our experience of color. Crucially, the conditions of the thought experiment have it that Mary knows everything there is to know about color but has never actually experienced it.
So what does this mean for Lambda and other AI systems?
The experiment shows how even if you have all the knowledge of physical properties available in the world, there are still further truths relating to the experience of those properties. There is no room for these truths in the physicality story.
By this argument, a purely physical machine may never be able to truly replicate a mind. In this case, Lambda is just seeming to be sentient.
The imitation game
So is there any way we can tell the difference?
The pioneering British computer scientist Alan Turing proposed a practical way to tell whether or not a machine is “intelligent”. He called it the imitation game, but today it’s better known as the Turing test.
In the test, a human communicates with a machine (via text only) and tries to determine whether they are communicating with a machine or another human. If the machine succeeds in imitating a human, it is deemed to be exhibiting human-level intelligence.
These are much like the conditions of Lemoyn’s chats with Lambda. It’s a subjective test of machine intelligence, but it’s not a bad place to start.
Beyond behavior
As a test of sentience or consciousness, Turing’s game is limited by the fact it can only assess behavior.
Another famous thought experiment, the Chinese room argument proposed by American philosopher John Searle, demonstrates the problem here.
The experiment imagines a room with a person inside who can accurately translate between Chinese and English by following an elaborate set of rules. Chinese inputs go into the room and accurate input translations come out, but the room does not understand either language.
What is it like to be human?
When we ask whether a computer program is sentient or conscious, perhaps we are just asking how much it is like us.
We may never really be able to know this.
The American philosopher Thomas Nagel argued we could never know what it is like to be a bat, which experiences the world via echolocation. If this is the case, our understanding of sentience and consciousness in AI systems might be limited by our particular brand of intelligence.
And what experiences might exist beyond our limited perspective? This is where the conversation starts to get interesting.
You must be logged in to post a comment.