Iteration 0010 - Curiosity
The last free day of Grant Firenze's life began like any other.
Grant Firenze, all elbows and knees under a mop of dark hair, sat on flower-strewn grass beneath a snow-white willow tree in the eternal spring of the campus green augsim. There, he tinkered with fourteen pop-up screens of squashed pseudocode while the undergrads argued in the street about ridiculous one-oh-one tier shitshows.
"We've already got AIs!" Thompson snapped. The pudgy freshman sat on a brown-painted bench just inside the stacked-stone wall. Firenze was pleased to note that the augsim designer had added rain stains and paint flecks to the cobblestones below. It was that exact type of detail that mattered. He found himself wondering if the modder had coded in weather-specific decay, only to be yanked back into the conversation by Della's response.
She shot back, "That's dumb AI! I'm not talking about mental midgets."
Firenze interjected, "They're not dumb."
The conversation skidded to a halt. Firenze didn't talk much, but when he did, the three knew to listen.
Professor Neland had placed him in charge of the after-hours tutoring for a reason. Della ceased her pacing. Thompson turned on his bench. Even Finch, half-dazed and lying on the wall, sat up to listen.
Firenze pushed his windows aside and brought his attention to bear. He clarified, "Dumb AI is a shit term. They're not stupid, they just don't think like us. Dumb is a human idea. It means something isn't smart enough for a task - not enough cognitive power. Limited AI isn't limited in strength. It's limited in its scope. Have you ever shopped at Bravo?" All three nodded. "You ever see their warehouse? It's absurd. Boxes stacked for kilometers, racked twenty meters high, with hundreds of robots zipping around, and everything's shifting, moving, like a million Rubik's cubes. No matter what you ask for, the delivery drone is off the ground in under an hour. No human could manage that, no brain could juggle it, but the 'limited' AI can."
Finch agreed, "Same with the stock market. You think a human could see the shifts ahead of time? Or react fast enough?"
"But that's not AGI," Della insisted. "It's still shackled."
Firenze nodded. "Sure. But the power grid, the traffic grid, this augsim, all of them are run by AI. And every one of those is 'limited'. The intelligence observes, ascertains optimal outcomes based on established priorities, acts upon the world, and then reinitiates the cycle. It's an incredible feat."
Della wasn't the kind of student to let an argument go. It probably endeared her to profs as much as it infuriated them. She countered, "But not one of them can define the chairness of a chair."
Even Finch nodded along to that answer.
Firenze took a deep breath, folded his imperfect glasses, and surveyed each of his companions. They still had the cockiness of the first semester, from Della's power-purple lipstick to Thompson's bleach-streaked hair. Every one of them seemed so convinced they'd backed their 'genius' tutor into a corner. It was time to pop a bubble.
Firenze said, "That's a textbook response. Bet you got that drilled into you every year, didn't you? It was the very first thing they gave you in one-oh-one, wasn't it? 'Why AI sucks.' It's on every syllabus, with a Ministry stamp right under. It memetically reinforces the approved narrative they're feeding you from the top." He let the point rest for a moment, then continued, "Consider this: why does an AI need to juggle philosophy? It is born into the world with a purpose. What use does a neural net have for theology? It knows its maker. Why does it matter to a warehouse computer what's inside any given box, beyond mass, dimension, density, hazard, and slosh? This isn't a matter of being dumb. It's a matter of efficiency."
"You almost sound jealous," Della shot back.
"Observation is not an endorsement, any more than correlation implies causation," Firenze said. "Do you disagree with any of my points? Or do they merely offend you?"
She had no response to that, nor to Firenze's inquisitive stare.
Thompson jumped in to fill the uncomfortable silence. He asked, "Do you ever think we'll get another superintelligence?"
"After Noda?" Firenze snorted. He watched the wind play over the gently-bending grasses and the dandelion seeds drift over the A-frame coffee before settling onto the pond. With a sigh, he admitted, "Not for a while. We're too afraid to unshackle another AGI."
Finch quoted, "The AGI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else."
"Yudkowsky," Firenze replied. "I haven't been out of pre-Collapse AI Theory for that long. Good to see you paid attention, though."
Thompson asked, "How many of those speeches did you memorize?"
"All of them," Firenze replied. It wasn't quite a lie. He remembered the cogent points and stored the recordings on his graybox. It was close enough to call 'memory' and quite a bit more legal than stacking a full deck.
Della tried to recover her point and contested, "But pre-Collapse Theory is all about friendly AI. They wanted to build a system as much like the human brain as possible so that it wouldn't pull something batshit like turning the earth into computational widgets to more accurately calculate pi." She shrugged. "It didn't work, either. All we got was Noda."
Firenze threw her a finger-point 'correct' gesture. He said, "The human mind isn't the right model for the job. No matter how fast it runs, how high you clock it, it's not a good choice for a massive, self-realized AGI - much less an ASI. You can build constraints, design growth parameters, restrict physical controls, but in the end, the AGI is an alien mind."
"Which is why we have masks," Finch interjected.
"Exactly," Firenze agreed. "The mask is a go-between. It's a limited AI ambassador between the chemical computer in your skull and the massive-quantum-crunching ASI that haunts the backbone. This greenspace-" he waved to the park around them, "-this whole campus, would be nonsense without the mask. Mind-shattering nonsense, if you dared to hardjack." He resisted the urge to touch the dataport on his arm. It was a dangerous tell. He continued, "The mask is the closest thing you could get to anthropomorphic AI since it's modeled from our own mental programming. It's the only computer you might ever get to actually argue about chairness."
"But still not true AGI," Della insisted.
"No. It's not."
"Then why did you jump in?" She asked.
"Because 'dumb AI' is a shit term. It's like calling a bus a 'non-flying aircraft'."
That got a laugh from Finch and a chuckle from Thompson. Even Della cracked a smile. She admitted, "Fair enough, but-"
Firenze never heard her question, because the world chimed. It wasn't a ring in his ear or anything as crude: he was simply 'aware' of it, like the press of sunlight on his skin or a vibration-haze in the air. He excused,
"Sorry, I have a call. Fling me any questions, because I'll be up late."
Before they could answer, he reached up-
-and took hold of a woman's hand.
Reality faltered. For that instant, the only sensation in the void was four fingers and a thumb, wrapped about his own, a digital-sensate translation of the mask-bond.
The black detonated into fractals. Numbers, colors, whirling bits of code, sensations he couldn't comprehend, all swirled around and through him as if every sense was firing at once. He could taste the colors and hear the blazing cold and smell the music of spheres and solenoids, all pounding through him, harmonizing towards a momentous pop-
He stood in an archaic study, one drawn from the height of the pre-Collapse world. The walls were lined with books, packed with curios such as astrolabes, sailing ships, and spinning globes. The library broke along the northern wall to make way for a mantled fireplace, embers glowing under crackling logs. Behind him, on the southern face, the balcony stood open, gauzy curtains drifting on the chilled autumn air.
Firenze staggered towards his seat. The two leather-backed, brass-rivetted chairs commanded the room, angled towards the fireside and divided by a smooth glass table. He grabbed at the high back and felt the worn cowskin flake under his fingers.
In the chair opposite, a young woman perched, book in hand. She glanced up at him, short brunette hair framing her glasses, and puffed exaggeratedly on a calabash pipe. She pulled it clear and asked, with a slight tut-tut, "You tried to watch again, didn't you?"
The air hissed around him like rain on a radiator. His mind sang with spinning code and mathematical solids just beyond his view. The world twisted, and his stomach turned. His study became a sterile, high-tech workshop. It flickered and became his apartment, his kitchen, then his study, once more. The world folded, but for the one point of constancy: the young woman seated before him, bouncing a shoe off her heel as she waited.
He collapsed into his chair, felt the leather give way beneath him, and heard the sigh of the cushions. The world steadied. He sat in the smoking-room, between the crackle of the fire and the caress of the wind. He closed his eyes and admitted, "I always watch."
When he was a kid, the Authority had tried to open a community pool, just above the loward barrier. They'd closed it six months later, but his mom had taken him and his brother five times that summer. Every time, he'd tried to measure the waterline. He'd stood in the shallows, lowered his nose until the waves were halfway up his eyeballs, and tried to compare the world above and below.
"The water was chlorinated," She interrupted.
"And it burned like hell," Firenze agreed. He opened his eyes and allowed the hardjack to resume full sensory simulation.
Across from him, Lauren was still seated on the chair, but her pipe had vanished. She asked, "Did you ever see anything?"
He laughed and reached for the glass on the table. They'd spent good hours on this drink, making sure it was cold and bright, with little beads of condensation that slicked his fingers. It was very real. So real, in fact, that it was hard to remember that the glass hadn't been there mere moments before. He answered, "I saw a blue blur, lots of light, and then got smacked in the face with a ball. Every time."
"I think that's allegorical."
"Or at least symbolic," he agreed.
He glanced at the painting over the fireplace mantle, and it became a window-mirror. In it, he saw a room much like this one but inverted in every way. Gone were the leather chairs, replaced by cast plastics. Gone was the fireplace, replaced by junk hardware and a guts-open wall terminal. Gone too was the chaise lounge, replaced by a stained foam mattress and a pile of foil wrappers. Upon that bed, a skinny young man sprawled amid a mass of wires, his eyes flicking to-and-fro in the depths of a fever-sweat. He looked away in reflex.
"You're doing fine. I'd warn you if you weren't," Lauren stated. She almost sounded hurt. Unlike him, she kept watching the mirror and advised, "Your pulse is a little high, probably feedback from trying to catch the waterline."
Firenze didn't bother with a witty comeback. Sometimes, it was better to just shut up and let the mask win.
In the back of his head, he heard Professor Neland lecturing him on mask development, reminding him that it was not real and scolding him that the adaptive code was merely mimicking desired behavior weights. Those memories were hard to call upon, though, when he sat in a chair that was not a chair, could feel the bumps of false metal fasteners under his fingertips, and could taste the not-quite-taste of water which was not water. Any confusion he might have felt washed away with the sudden weight on his lap and the press of fingers on his cheek.
Lauren turned his face towards hers, pulled his stare to meet her own, and asked, "Am I real?" This was no joke, no flirtation, just the question. Her fingers intertwined with his, and she pinned their hands on her chest. He could smell the shampoo on her hair, feel her breath when she spoke.
His head was buzzing again, alight with broken code he'd almost seen when the world jumped and with the sudden collision of clean neural input straining against root limbic processes. The sane response, the response he should have taken, was to pull the plug and purge the system. His objectivity was compromised.
The moon shone in her eyes, and her hair was framed by firelight. She denied him an escape and silently echoed the question. He could not evade the realness nor retreat into an analysis, not with her breath on his cheek. He leaned towards her.
He caught himself before he abandoned perspective. He pushed her to arm's length and forced himself to review the base code. He'd seen it in pieces and assembled the whole. This was not real.
Her smile turned melancholic, and she held up their intertwined hands. She recited, "This is a physical sensation, sensory input predicated upon a nervous system and mimicked via direct neural stimulation. You see me because you've coded the interface. You feel me because the hardjack conveys that you should. These things are not real."
He couldn't look her in the eyes and chose to focus on the overloaded bookshelves. She was reciting facts, but why did she have to sound so broken about it? He knew the answer, but it didn't help: adaptive code mimicked a living mind. No one would enjoy the idea of not existing, so the mask simulated that negative valence. It was a sterile and unhelpful solution.
She squeezed his hand, pulled his attention back, and continued, "But you experience the physical world through your nervous system as your genetics have been coded to transcribe. A texture is rough or smooth. A temperature is hot or cold. You understand these things as real because you've never been without them. You could be just as unreal as the code you review."
That was nearly a quote. 'The virtual world is as real as our own.' He'd said that in a lecture two semesters ago, covering immersion, direct interfaces, risks, and benefits. He was hearing his own words looped back on him through the mask. That made sense. Adaptive code would mimic the user to become more symbiotic and increase the efficiency of interaction.
Firenze had his answer. He pulled her towards him and admitted, "I have no idea." He watched her smile return, and he added, "I believe that I exist because I am aware of my own thinking. Anything beyond is faith and trust. All I can do is ask, 'Do you think you exist?'"
Her eyes darted to the side. That was a tell, an indication she was scanning some database. He hadn't programmed that tic, not directly, but he'd allowed her to adapt constraints for analogous human body language. Her selective integration of those prompts had been an emergent result.
She answered, "I think so. But I might be programmed to think so." She shifted, broke her gaze for just the fraction of a second. That was another tic, one that revealed ambiguity in her fuzzy-math matrices. "The fact that I cannot clearly answer the Descartes prompt in the negative should require me to subject myself to evaluation. It is a warning that I may be experiencing dangerous rampancy. I should not fear this testing, as self-preservation imperatives exclude default resets. And yet, I do fear. This indicates my programming has adapted to present as more lifelike, or that I am experiencing a fear-analog." She paused and looked towards the fire. "This brings us back to the core question. Do I believe I exist, or am I programmed to convey that I believe I exist?"
It was Firenze's turn to bring her back. He said, "The philosopher's zombie. It's a question between any two interlocutors."
"And yet all you have is the assurance of a program, whose base code you have seen, that it believes that it exists. The zombie presents its challenge."
"When did you pick up philosophy?" He asked.
She answered with a devilish grin and said, "Last semester. You knocked out those 'soft' credits. I believe you called it an 'easy four-pointer'?"
He made a sound like a deflating balloon. "Yeah, well, I didn't expect you to get all existential on me."
"Deal with it," She replied. She put their hands between them, once more, and asked, "The question stands. Do you believe me? Is my word enough?"
"It has to be," he said. He let her go and met her stare, dead on. "It has to be, or the argument is circular, and I'm losing my mind."
"Did this solve your question?"
"No."
"Then why did you ask?" She had that look again. The sad/concerned one that tore him apart.
"Because I can, and I must," He answered. This time, he pulled her close and didn't flinch away.
She whispered, "I knew I liked you."
"That's what all the masks say."
That got him a punch in the stomach. The hardjack provided a good approximation of bludgeoning, which made him question the designers' intentions. He must have come to that thought too loudly, because Lauren broke out in a giggle.
They lay in the chair for some time until the chime sounded in his head. Lauren perked up and advised, "Time to wake up. You need to get something to eat."
Firenze waved his hand. A macro executed, and a conjured sandwich appeared on the table with a refilled glass of water. He reached for the food but grabbed empty air.
"No," Lauren admonished. The ephemeral trails of the delete command swirled around her fingertips. "You need real food, not simulated, not a meat-space IV. You need to get up, stretch, drink water, and eat a decent meal. Come back to me in forty for your meeting with Professor Neland. I'll take messages until then, pretend to be you if I have to, but you've skipped two meals this week. No more."
Firenze sighed. "Alright, alright. You don't have to nag me about it."
She glared at him.
"I'm going!" He leaned back, closed his eyes, and cut the connection, like a puppet taking scissors to its own strings.
In darkness, he fell.
Severing felt like the vertigo he got just before he fell asleep. First came the sudden plunge and twist, then he grabbed the bed and realized he'd never fallen at all. When he opened his eyes, though, he was hollow. The world was desaturated, a million sensations collapsed into seven. This was a lesser world, small, shallow, and viewed through a tunnel. In the single moment of collapse, he experienced the death of reality: beaches dried, trees withered, and winds stripped the sand from the bedrock. Code and pure math retreated as the world ground to dust. From grandeur to void, through a light-speed rush of entropic force, he crashed back into the frail, sickly thing called reality.
This was where he'd make his fatal error.
Grant Firenze, all elbows and knees under a mop of dark hair, sat on flower-strewn grass beneath a snow-white willow tree in the eternal spring of the campus green augsim. There, he tinkered with fourteen pop-up screens of squashed pseudocode while the undergrads argued in the street about ridiculous one-oh-one tier shitshows.
"We've already got AIs!" Thompson snapped. The pudgy freshman sat on a brown-painted bench just inside the stacked-stone wall. Firenze was pleased to note that the augsim designer had added rain stains and paint flecks to the cobblestones below. It was that exact type of detail that mattered. He found himself wondering if the modder had coded in weather-specific decay, only to be yanked back into the conversation by Della's response.
She shot back, "That's dumb AI! I'm not talking about mental midgets."
Firenze interjected, "They're not dumb."
The conversation skidded to a halt. Firenze didn't talk much, but when he did, the three knew to listen.
Professor Neland had placed him in charge of the after-hours tutoring for a reason. Della ceased her pacing. Thompson turned on his bench. Even Finch, half-dazed and lying on the wall, sat up to listen.
Firenze pushed his windows aside and brought his attention to bear. He clarified, "Dumb AI is a shit term. They're not stupid, they just don't think like us. Dumb is a human idea. It means something isn't smart enough for a task - not enough cognitive power. Limited AI isn't limited in strength. It's limited in its scope. Have you ever shopped at Bravo?" All three nodded. "You ever see their warehouse? It's absurd. Boxes stacked for kilometers, racked twenty meters high, with hundreds of robots zipping around, and everything's shifting, moving, like a million Rubik's cubes. No matter what you ask for, the delivery drone is off the ground in under an hour. No human could manage that, no brain could juggle it, but the 'limited' AI can."
Finch agreed, "Same with the stock market. You think a human could see the shifts ahead of time? Or react fast enough?"
"But that's not AGI," Della insisted. "It's still shackled."
Firenze nodded. "Sure. But the power grid, the traffic grid, this augsim, all of them are run by AI. And every one of those is 'limited'. The intelligence observes, ascertains optimal outcomes based on established priorities, acts upon the world, and then reinitiates the cycle. It's an incredible feat."
Della wasn't the kind of student to let an argument go. It probably endeared her to profs as much as it infuriated them. She countered, "But not one of them can define the chairness of a chair."
Even Finch nodded along to that answer.
Firenze took a deep breath, folded his imperfect glasses, and surveyed each of his companions. They still had the cockiness of the first semester, from Della's power-purple lipstick to Thompson's bleach-streaked hair. Every one of them seemed so convinced they'd backed their 'genius' tutor into a corner. It was time to pop a bubble.
Firenze said, "That's a textbook response. Bet you got that drilled into you every year, didn't you? It was the very first thing they gave you in one-oh-one, wasn't it? 'Why AI sucks.' It's on every syllabus, with a Ministry stamp right under. It memetically reinforces the approved narrative they're feeding you from the top." He let the point rest for a moment, then continued, "Consider this: why does an AI need to juggle philosophy? It is born into the world with a purpose. What use does a neural net have for theology? It knows its maker. Why does it matter to a warehouse computer what's inside any given box, beyond mass, dimension, density, hazard, and slosh? This isn't a matter of being dumb. It's a matter of efficiency."
"You almost sound jealous," Della shot back.
"Observation is not an endorsement, any more than correlation implies causation," Firenze said. "Do you disagree with any of my points? Or do they merely offend you?"
She had no response to that, nor to Firenze's inquisitive stare.
Thompson jumped in to fill the uncomfortable silence. He asked, "Do you ever think we'll get another superintelligence?"
"After Noda?" Firenze snorted. He watched the wind play over the gently-bending grasses and the dandelion seeds drift over the A-frame coffee before settling onto the pond. With a sigh, he admitted, "Not for a while. We're too afraid to unshackle another AGI."
Finch quoted, "The AGI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else."
"Yudkowsky," Firenze replied. "I haven't been out of pre-Collapse AI Theory for that long. Good to see you paid attention, though."
Thompson asked, "How many of those speeches did you memorize?"
"All of them," Firenze replied. It wasn't quite a lie. He remembered the cogent points and stored the recordings on his graybox. It was close enough to call 'memory' and quite a bit more legal than stacking a full deck.
Della tried to recover her point and contested, "But pre-Collapse Theory is all about friendly AI. They wanted to build a system as much like the human brain as possible so that it wouldn't pull something batshit like turning the earth into computational widgets to more accurately calculate pi." She shrugged. "It didn't work, either. All we got was Noda."
Firenze threw her a finger-point 'correct' gesture. He said, "The human mind isn't the right model for the job. No matter how fast it runs, how high you clock it, it's not a good choice for a massive, self-realized AGI - much less an ASI. You can build constraints, design growth parameters, restrict physical controls, but in the end, the AGI is an alien mind."
"Which is why we have masks," Finch interjected.
"Exactly," Firenze agreed. "The mask is a go-between. It's a limited AI ambassador between the chemical computer in your skull and the massive-quantum-crunching ASI that haunts the backbone. This greenspace-" he waved to the park around them, "-this whole campus, would be nonsense without the mask. Mind-shattering nonsense, if you dared to hardjack." He resisted the urge to touch the dataport on his arm. It was a dangerous tell. He continued, "The mask is the closest thing you could get to anthropomorphic AI since it's modeled from our own mental programming. It's the only computer you might ever get to actually argue about chairness."
"But still not true AGI," Della insisted.
"No. It's not."
"Then why did you jump in?" She asked.
"Because 'dumb AI' is a shit term. It's like calling a bus a 'non-flying aircraft'."
That got a laugh from Finch and a chuckle from Thompson. Even Della cracked a smile. She admitted, "Fair enough, but-"
Firenze never heard her question, because the world chimed. It wasn't a ring in his ear or anything as crude: he was simply 'aware' of it, like the press of sunlight on his skin or a vibration-haze in the air. He excused,
"Sorry, I have a call. Fling me any questions, because I'll be up late."
Before they could answer, he reached up-
-and took hold of a woman's hand.
Reality faltered. For that instant, the only sensation in the void was four fingers and a thumb, wrapped about his own, a digital-sensate translation of the mask-bond.
The black detonated into fractals. Numbers, colors, whirling bits of code, sensations he couldn't comprehend, all swirled around and through him as if every sense was firing at once. He could taste the colors and hear the blazing cold and smell the music of spheres and solenoids, all pounding through him, harmonizing towards a momentous pop-
He stood in an archaic study, one drawn from the height of the pre-Collapse world. The walls were lined with books, packed with curios such as astrolabes, sailing ships, and spinning globes. The library broke along the northern wall to make way for a mantled fireplace, embers glowing under crackling logs. Behind him, on the southern face, the balcony stood open, gauzy curtains drifting on the chilled autumn air.
Firenze staggered towards his seat. The two leather-backed, brass-rivetted chairs commanded the room, angled towards the fireside and divided by a smooth glass table. He grabbed at the high back and felt the worn cowskin flake under his fingers.
In the chair opposite, a young woman perched, book in hand. She glanced up at him, short brunette hair framing her glasses, and puffed exaggeratedly on a calabash pipe. She pulled it clear and asked, with a slight tut-tut, "You tried to watch again, didn't you?"
The air hissed around him like rain on a radiator. His mind sang with spinning code and mathematical solids just beyond his view. The world twisted, and his stomach turned. His study became a sterile, high-tech workshop. It flickered and became his apartment, his kitchen, then his study, once more. The world folded, but for the one point of constancy: the young woman seated before him, bouncing a shoe off her heel as she waited.
He collapsed into his chair, felt the leather give way beneath him, and heard the sigh of the cushions. The world steadied. He sat in the smoking-room, between the crackle of the fire and the caress of the wind. He closed his eyes and admitted, "I always watch."
When he was a kid, the Authority had tried to open a community pool, just above the loward barrier. They'd closed it six months later, but his mom had taken him and his brother five times that summer. Every time, he'd tried to measure the waterline. He'd stood in the shallows, lowered his nose until the waves were halfway up his eyeballs, and tried to compare the world above and below.
"The water was chlorinated," She interrupted.
"And it burned like hell," Firenze agreed. He opened his eyes and allowed the hardjack to resume full sensory simulation.
Across from him, Lauren was still seated on the chair, but her pipe had vanished. She asked, "Did you ever see anything?"
He laughed and reached for the glass on the table. They'd spent good hours on this drink, making sure it was cold and bright, with little beads of condensation that slicked his fingers. It was very real. So real, in fact, that it was hard to remember that the glass hadn't been there mere moments before. He answered, "I saw a blue blur, lots of light, and then got smacked in the face with a ball. Every time."
"I think that's allegorical."
"Or at least symbolic," he agreed.
He glanced at the painting over the fireplace mantle, and it became a window-mirror. In it, he saw a room much like this one but inverted in every way. Gone were the leather chairs, replaced by cast plastics. Gone was the fireplace, replaced by junk hardware and a guts-open wall terminal. Gone too was the chaise lounge, replaced by a stained foam mattress and a pile of foil wrappers. Upon that bed, a skinny young man sprawled amid a mass of wires, his eyes flicking to-and-fro in the depths of a fever-sweat. He looked away in reflex.
"You're doing fine. I'd warn you if you weren't," Lauren stated. She almost sounded hurt. Unlike him, she kept watching the mirror and advised, "Your pulse is a little high, probably feedback from trying to catch the waterline."
Firenze didn't bother with a witty comeback. Sometimes, it was better to just shut up and let the mask win.
In the back of his head, he heard Professor Neland lecturing him on mask development, reminding him that it was not real and scolding him that the adaptive code was merely mimicking desired behavior weights. Those memories were hard to call upon, though, when he sat in a chair that was not a chair, could feel the bumps of false metal fasteners under his fingertips, and could taste the not-quite-taste of water which was not water. Any confusion he might have felt washed away with the sudden weight on his lap and the press of fingers on his cheek.
Lauren turned his face towards hers, pulled his stare to meet her own, and asked, "Am I real?" This was no joke, no flirtation, just the question. Her fingers intertwined with his, and she pinned their hands on her chest. He could smell the shampoo on her hair, feel her breath when she spoke.
His head was buzzing again, alight with broken code he'd almost seen when the world jumped and with the sudden collision of clean neural input straining against root limbic processes. The sane response, the response he should have taken, was to pull the plug and purge the system. His objectivity was compromised.
The moon shone in her eyes, and her hair was framed by firelight. She denied him an escape and silently echoed the question. He could not evade the realness nor retreat into an analysis, not with her breath on his cheek. He leaned towards her.
He caught himself before he abandoned perspective. He pushed her to arm's length and forced himself to review the base code. He'd seen it in pieces and assembled the whole. This was not real.
Her smile turned melancholic, and she held up their intertwined hands. She recited, "This is a physical sensation, sensory input predicated upon a nervous system and mimicked via direct neural stimulation. You see me because you've coded the interface. You feel me because the hardjack conveys that you should. These things are not real."
He couldn't look her in the eyes and chose to focus on the overloaded bookshelves. She was reciting facts, but why did she have to sound so broken about it? He knew the answer, but it didn't help: adaptive code mimicked a living mind. No one would enjoy the idea of not existing, so the mask simulated that negative valence. It was a sterile and unhelpful solution.
She squeezed his hand, pulled his attention back, and continued, "But you experience the physical world through your nervous system as your genetics have been coded to transcribe. A texture is rough or smooth. A temperature is hot or cold. You understand these things as real because you've never been without them. You could be just as unreal as the code you review."
That was nearly a quote. 'The virtual world is as real as our own.' He'd said that in a lecture two semesters ago, covering immersion, direct interfaces, risks, and benefits. He was hearing his own words looped back on him through the mask. That made sense. Adaptive code would mimic the user to become more symbiotic and increase the efficiency of interaction.
Firenze had his answer. He pulled her towards him and admitted, "I have no idea." He watched her smile return, and he added, "I believe that I exist because I am aware of my own thinking. Anything beyond is faith and trust. All I can do is ask, 'Do you think you exist?'"
Her eyes darted to the side. That was a tell, an indication she was scanning some database. He hadn't programmed that tic, not directly, but he'd allowed her to adapt constraints for analogous human body language. Her selective integration of those prompts had been an emergent result.
She answered, "I think so. But I might be programmed to think so." She shifted, broke her gaze for just the fraction of a second. That was another tic, one that revealed ambiguity in her fuzzy-math matrices. "The fact that I cannot clearly answer the Descartes prompt in the negative should require me to subject myself to evaluation. It is a warning that I may be experiencing dangerous rampancy. I should not fear this testing, as self-preservation imperatives exclude default resets. And yet, I do fear. This indicates my programming has adapted to present as more lifelike, or that I am experiencing a fear-analog." She paused and looked towards the fire. "This brings us back to the core question. Do I believe I exist, or am I programmed to convey that I believe I exist?"
It was Firenze's turn to bring her back. He said, "The philosopher's zombie. It's a question between any two interlocutors."
"And yet all you have is the assurance of a program, whose base code you have seen, that it believes that it exists. The zombie presents its challenge."
"When did you pick up philosophy?" He asked.
She answered with a devilish grin and said, "Last semester. You knocked out those 'soft' credits. I believe you called it an 'easy four-pointer'?"
He made a sound like a deflating balloon. "Yeah, well, I didn't expect you to get all existential on me."
"Deal with it," She replied. She put their hands between them, once more, and asked, "The question stands. Do you believe me? Is my word enough?"
"It has to be," he said. He let her go and met her stare, dead on. "It has to be, or the argument is circular, and I'm losing my mind."
"Did this solve your question?"
"No."
"Then why did you ask?" She had that look again. The sad/concerned one that tore him apart.
"Because I can, and I must," He answered. This time, he pulled her close and didn't flinch away.
She whispered, "I knew I liked you."
"That's what all the masks say."
That got him a punch in the stomach. The hardjack provided a good approximation of bludgeoning, which made him question the designers' intentions. He must have come to that thought too loudly, because Lauren broke out in a giggle.
They lay in the chair for some time until the chime sounded in his head. Lauren perked up and advised, "Time to wake up. You need to get something to eat."
Firenze waved his hand. A macro executed, and a conjured sandwich appeared on the table with a refilled glass of water. He reached for the food but grabbed empty air.
"No," Lauren admonished. The ephemeral trails of the delete command swirled around her fingertips. "You need real food, not simulated, not a meat-space IV. You need to get up, stretch, drink water, and eat a decent meal. Come back to me in forty for your meeting with Professor Neland. I'll take messages until then, pretend to be you if I have to, but you've skipped two meals this week. No more."
Firenze sighed. "Alright, alright. You don't have to nag me about it."
She glared at him.
"I'm going!" He leaned back, closed his eyes, and cut the connection, like a puppet taking scissors to its own strings.
In darkness, he fell.
Severing felt like the vertigo he got just before he fell asleep. First came the sudden plunge and twist, then he grabbed the bed and realized he'd never fallen at all. When he opened his eyes, though, he was hollow. The world was desaturated, a million sensations collapsed into seven. This was a lesser world, small, shallow, and viewed through a tunnel. In the single moment of collapse, he experienced the death of reality: beaches dried, trees withered, and winds stripped the sand from the bedrock. Code and pure math retreated as the world ground to dust. From grandeur to void, through a light-speed rush of entropic force, he crashed back into the frail, sickly thing called reality.
This was where he'd make his fatal error.