“Ha! You’re absolutely right, master robot. Well, then, you’ve scored a point by accident, Avery.”
Avery managed to keep his teeth from grinding audibly. Bowing slightly, he said, “Thank you, madam. Now if you’d like to look over this way, perhaps we can design a place where you and your company can be comfortable during your stay?”
Wolruf surveyed the scene before her with a sense of amusement she hadn’t felt in years. They had moved from the top of the tower to Juliana Welsh’s new palace, where she had decided to test the city’s catering facilities by throwing an impromptu cocktail party where the entire group of eight humans-counting Wolruf-and seven personal robots could engage in calculated debate amid a sea of hors d’oeuvres while dozens of service robots milled about making sure that everyone had a fresh drink and a taste of fish eggs on toast.
At least it had started out that way, but the party had finally broken into groups. Now Ariel and her mother stood a little to one side, whispering furiously to one another while everyone else pretended not to notice. Derec and Juliana’s two male companions, Jon and Ivan, sat in high-backed recliners with their feet up on puffy stools, laughing loudly at Derec’s stories of his adventures among the aliens of the Fringe worlds. Janet and Dr. Avery stood beside the champagne fountain, refilling their glasses often and shifting from side to side as they spiraled around and around the topic neither had dared to broach while sober.
The robots-learning machines, Mandelbrot, Basalom, and Juliana’s two valets-stood silently in the periphery, neither in the traditional robot niches in the walls nor venturing into the middle of the party. The learning machines could probably have gotten away with it, after successfully passing Ms. Welsh’s ad-lib Turing test, but they chose instead to remain unobtrusive and exchange their ideas with the other robots instead.
Wolruf was nominally a part of Derec’s group, but she hadn’t contributed a story for half an hour at least. She was having too much fun just people-watching and letting her mind drift. Derec’s stories had gotten her to thinking about her own adventures, most of them the same as his but a few of which he hadn’t shared. She was thinking about her childhood dream of cruising the stars in her own spaceship, deliberately seeking adventure and fabulous riches on strange, alien worlds. It hadn’t quite worked as planned; she’d started out her travels as a slave in Aranimas’s ship, and from then on adventure had more often than not come seeking her rather than the other way around. Still, she supposed some of the dream had worked out as planned. She would be returning home with riches enough to destabilize a two-world economy-enough for any voyager.
She would return with robots, she had decided. Four blank learning machines, modified to have the Zeroth Law of robotics included from the start, just as Janet had suggested. Wolruf would ask for one other modification as well: an off switch in the form of a time-bomb cell like the one that had given Mandelbrot his name. She wasn’t sure just what the trigger would be yet, but she imagined it would have something to do with accumulated responsibility. When the mayor began to edge over into behavior more appropriate to a dictator-and Wolruf wasn’t so naive as to believe that wouldn’t be possible-then it would be time for a new learning machine to take over the job.
Even so, the system wouldn’t be perfect. There were bound to be other bugs to work out, just as Derec had indicated to Juliana. The prospect excited Wolruf, just as she knew it would excite those at home. Perfection had been her biggest worry. She had heard enough Utopia stories in her life to know that the curse, “May you live in interesting times,” had been misquoted.
Derec and the two gentlemen from Aurora laughed again at something one of them had said. Wolruf leaned forward again to catch up on the topic of conversation, but Derec spared her the effort by saying, “Hey, Wolruf, why don’t you tell these guys about the time we had to talk the learning machines out of throwing you out the airlock?”
Had that really happened? Wolruf had to pause a moment and shuffle through her memories, but sure enough, she had actually been within a few minutes of breathing vacuum because of those very robots in the comer. Only quick thinking on Derec’s and Wolruf’s parts had saved her golden hide. She felt a thrill of remembered terror raise the fur over her entire body-a reaction that delighted her audience immensely. She smoothed herself down and began the tale, wondering as she did what other stories were still to come.
The enormous dining hall was silent, but as usual when robots were present, that silence hid an enormous amount of activity. Seven robots stood deep in communication fugue, sharing entire lifetimes of experience base and correlating world-views in a flood of information exchange.
They had just completed an extensive recounting of the experiences and logic processes that had led to the conclusion that certain robots, under certain conditions, could be considered functionally human, and how that would allow them to administer robot cities and prevent them from destroying their inhabitants’ diversity.
Juliana’s two robots, Albert and Theodora, had listened with the patience only a robot could exhibit, occasionally asking for clarification or offering an observation of their own, but when Lucius, the self-appointed spokesman for the others, finished speaking, they immediately went into private conference.
A moment later Albert said, What you have done is impressive; however, it only accelerates a problem that has become evident back home on the Spacer worlds.
What problem is that?Lucius had asked.
The problem of robot intervention in human affairs.Albert paused momentarily to allow the others’ curiosity integrals to rise, then said, There is growing evidence that every time a robot provides a service for a human, no matter how trivial the service, that human ’ s initiative suffers a small but definite setback. We further suspect that the effect is cumulative over time, and that humanity as a whole already suffers greatly from it.
Explain your reasoning,said Lucius.
You have already explained much of it yourself. It seems this is an idea whose time has come, for you nearly reached the same conclusion independently. You worried that these cities would suppress individuality among their inhabitants, and that is so. You worried that having too much done for them by robots would lead to laziness and lack of initiative,and that is also correct. Your only incorrect line of reasoning was to conclude that a robotic “mayor” could prevent that from happening.
Lucius felt a brief wave of the same bias he had felt before toward Avery-anger, Adam had called it, but Lucius would never have recognized it as that himself. To him it merely felt like a bias on his logic. In fact, if he had not been so concerned with his thought processes, he actually would have assumed that he was thinking more clearly, rather than less so. Strange that it was so easy to recognize in another, but so difficult to recognize in oneself. And equally strange how, once recognized, the bias was still hard to neutralize. Lucius did so anyway, in deference to his guests, then said, Explain how you believe our reasoning to be incorrect.
Your error lies in assuming that there is a threshold level below which the effect is insignificant. There is none. Every act of robotic assistance affects humanity. A robot mayor might be able to preserve individuality, but you would at the same time make the city ’ s inhabitants dependent upon robots for their leaders. Thus in the long run they would lose more initiative under that system than they are losing to us now.