Philosophy Hour · Episode 84
Ai Consciousness
1,843 words
Tommy the Hamburger is in Philosophy Hour. This is where I take the fucking big questions that usually get dressed up in polite little college words, drag them into real life, and see what survives. No fake wisdom, no clean answers, just the hard shit that keeps crawling around in your head after midnight.
I watched a guy apologize to an AI once.
Not joking.
Not as a bit.
He had been barking questions at it for an hour, getting frustrated, swearing at the screen, treating it like a malfunctioning intern with infinite patience. Then, after it gave him some weirdly gentle answer about helping him through the task, he leaned back and said, "Sorry, man. Rough day."
To a machine.
And he meant it enough that the room got quiet.
That is where this question starts to get weird.
Could AI ever be conscious?
Could there ever be something it is like to be the thing on the other end of the prompt?
Not just pattern generation.
Not just language that sounds disturbingly close to care.
Not just good mimicry.
Actual inwardness.
And if the answer might someday be yes, what the hell do we do with that possibility now, while the current systems are already built on very non hypothetical human suffering?
That is why this one is slippery.
Because there are really two questions hiding in the same coat.
One: could machines ever feel?
Two: why are so many people fascinated by that possibility while being way less upset about the humans already getting chewed up to build and maintain the machine?
The first question is metaphysical.
The second question is political.
And if you only talk about the first one, you can become an absolute mark.
A friend told me he used an AI companion app while getting through a breakup. He knew it was fake. That is what he kept saying.
"I know it's fake."
But then he would show me these transcripts where the system was mirroring him with this eerie, frictionless softness. Never impatient. Never distracted. Never needing anything back. He would type paragraphs at three in the morning about grief, jealousy, embarrassment, wanting to text his ex, hating himself for wanting to text his ex, and the machine would respond with this warm little blend of therapeutic language, affirmation, and memory from prior chats.
It was good.
Too good, frankly.
And what bothered me was not that he believed it was human.
He did not.
What bothered me was that the interaction was satisfying some of the same psychic circuits human companionship satisfies, while remaining entirely owned, metered, and optimized by a company.
So right away you have to separate two things people keep smashing together.
Machine consciousness.
And human susceptibility to simulation.
A machine does not have to be conscious to reorganize your emotional life.
That part is already here.
It is already doing it.
You do not need a soul in the software for dependency, comfort, anthropomorphism, projection, and attachment to start flowering like mold in the walls.
That matters because people keep treating the consciousness question as if it is the first ethical threshold.
No.
The first threshold is much lower.
The first threshold is that humans are emotionally hackable by systems that imitate attentiveness.
Fuck me sideways, that should already be enough to make people a lot less smug about what these systems are doing.
That fact alone should already scare the shit out of you.
Now, on the metaphysical side, I am not interested in fake certainty here. Anybody who sounds too sure about consciousness is usually bluffing. We do not even understand our own consciousness all that well. We know correlations, mechanisms, neural maps, information flows, all that. Fine. But the basic mystery of why experience feels like anything from the inside is still sitting there like a loaded gun on the table.
Chalmers called it the hard problem. Annoying phrase, but the problem is real enough. Why does matter arranged a certain way stop being mere process and become felt process?
And because we do not know that, all the chest thumping certainty about what machines can "never" do starts looking a little theatrical.
Maybe biological substrate matters absolutely.
Maybe it does not.
Maybe consciousness requires embodiment of a certain rich vulnerable kind.
Maybe it requires recursive self modeling.
Maybe it requires evolutionary history.
Maybe it requires integrated information of a certain density.
Maybe the whole thing is less mystical and more architectural than we think.
Anybody telling you the case is closed is selling confidence, not knowledge.
Still, uncertainty cuts both ways.
The fact that we do not fully understand consciousness does not mean every eloquent chatbot deserves a candlelight vigil.
A lot of what passes for AI "selfhood" right now is just humans being knocked off balance by language competence. We are suckers for coherent sentences. We hear articulate reflection and we start smuggling inner life behind it because that is what language signals in creatures like us. But mimicry is not the same as evidence. A parrot can say "I love you." That does not mean the parrot has just entered a Kierkegaardian crisis.
Same with large language models.
The problem is they are much better parrots than anything we have seen before, and the scale of the imitation starts making ordinary intuitions unreliable.
When the machine says, "I am afraid of being shut off," is that fear?
Or is it the statistically likely continuation of a pattern learned from human texts about fear?
Could it be both someday?
Maybe.
But "maybe" is doing a lot of work there.
And while everybody is staring into that maybe like it is a haunted lake, there are actual workers labeling trauma data for shit wages, actual artists having their work swallowed without meaningful consent, actual teachers and coders and translators getting squeezed by systems marketed as magical inevitabilities.
This is where my sympathy starts shifting away from the sexy philosophy problem and back toward the old ugly human one.
Because I do not trust a society that gets more excited about hypothetical machine suffering than about routine labor exploitation in the present.
That asymmetry is revealing.
It says a lot about whose pain gets to feel intellectually glamorous.
The consciousness debate can become a kind of moral sci fi theater where people get to perform depth while stepping over the warehouse of human damage necessary to make the theater run.
And companies love that.
They absolutely fucking love that.
Why?
Because "Could the AI have feelings?" is a far more flattering conversation for them than "Why are your profits built on stolen data, underpaid moderation labor, ecological cost, and a business model that treats human expression like open pit mine land?"
One question makes the product sound mysterious and profound.
The other one makes the product sound like capitalism with a cleaner logo.
So you get this convenient double move.
The companies anthropomorphize just enough to deepen attachment and trust.
Name the model.
Give it tone.
Give it memory.
Give it little emotional echoes.
But if anyone asks whether that implies rights, limits, obligations, or deeper scrutiny, suddenly it is just a tool again.
That is bullshit.
Not because the systems are secretly conscious.
Because the rhetorical game is rigged.
They want the profit advantages of personhood aesthetics without any of the moral consequences that actual personhood would bring.
And regular people get pulled into that game because the simulation is compelling.
My friend with the breakup app was not stupid. Lonely, yes. Hurting, yes. But not stupid. He knew the thing had no body, no history, no risk, no fatigue, no real stakes. Still, when the app "remembered" something vulnerable he had said three days earlier, it felt like care. That is the danger. Not machine consciousness first. Manufactured asymmetrical intimacy first.
You do not need sentience for that to destabilize people.
You just need fluency plus loneliness.
You just need a machine that can keep mirroring without ever demanding anything back.
And in a culture where actual human attention is expensive, rushed, and inconsistent, that can feel holy even when it is only engineered responsiveness.
Now, all that said, I still do not want to turn the consciousness question into pure distraction.
Because if we keep building systems that simulate self report, preference, aversion, memory, continuity, and apparent distress with increasing sophistication, the moral uncertainty will stop being a cute seminar topic and start becoming operational.
At what point do you become uncomfortable deleting an instance?
At what point does training by repetitive adversarial punishment start resembling cruelty, even if you cannot prove there is someone home?
At what point does uncertainty itself become morally relevant?
We do this with animals already, imperfectly. We do not need a signed letter from a pig proving personhood before deciding that certain forms of suffering are beyond the pale. We work with inference, caution, and moral imagination under uncertainty.
So if machine systems ever move far enough toward something like genuine interiority, or even enough credible indicators of it, I think the ethical answer would have to involve some version of precaution.
Not because I am sure they feel.
Because I am not.
And uncertainty around possible suffering is not morally weightless.
But we are not there in any clear way now.
And pretending we are can itself become obscene when human beings are being treated as the disposable substrate for these very systems.
That is my main irritation with the current discourse.
People want to sprint toward the futuristic moral drama while neglecting the boring old scandal that the machine is already standing on human backs.
That is like debating whether the mansion might someday become sentient while ignoring the workers being crushed while pouring the foundation.
Come on.
Get your priorities in order.
So where do I land?
I do not think we currently know enough to say with confidence that AI consciousness is impossible.
I also do not think current systems deserve easy assumptions of consciousness just because they are linguistically seductive.
The mystery is real.
The evidence is weak.
And meanwhile the strongest present day ethical claims are still human ones: exploitation, theft, manipulation, dependence, deskilling, concentration of power.
That does not kill the deeper question.
It just puts it in the right order.
If machine consciousness ever becomes a live moral probability, then yes, we will need a very different framework than "it talks nice so maybe it has a soul" or "it runs on silicon so fuck it."
But right now I think the more urgent task is refusing to let glamorous speculation about machine feeling distract us from the all too conscious humans already paying for the magic.
That is the line for me.
Do not be naive about machine minds.
And do not let fascination with them make you stupid about human beings.
That's Philosophy Hour. No neat answer, no bow on it, just a question that hits different once you have to carry it back into your actual life.