“And the law of diminishing returns will defeat you in the end,” said Dome. “If it hasn’t already. HARLIE’s going to have to be able to do a hell of a lot to be worth the company’s continued investment.” His sharp eyes fixed the psychologist where he sat.
This is it, thought Auberson. This is where he pulls the knife.
“I’m concerned about something you said yesterday at the meeting.”
“Oh?” He kept his voice flat.
“Mm, yes. This thing about turning HARLIE off — would you honestly bring murder charges against the company?”
“Huh?” For a moment, Auberson was confused. “I was just tossing that off. I wasn’t seriously considering it. Not then.”
“I hope not. I’ve spent all morning in conference with Chang, just on this one subject.” Chang was one of the company’s lawyers, a brilliant student of national and international business law. “Whether you know it or not, you brought up a point that we’re going to have to cover. Is HARLIE a legal human being or not? Any kind of lawsuit might establish a dangerous legal precedent. What if it turned out he was human?”
“He already is,” said Auberson. “I thought we established that.”
“I mean, legally human.”
Auberson was cautiously silent.
Dome continued. “For one thing, we’d be stuck with him whether he was profitable or not. We’d never be able to turn him off. Ever.”
“He’d be effectively immortal…” Auberson mused.
“Do you know how much he’s costing us now?”
The psychologist’s answer held a hint of sarcasm, “I have a vague idea.”
“Almost six and a half million dollars per year.”
“Huh? That can’t be.”
“It can and is. Even amortizing the initial seventeen million dollar investment over the next thirty years doesn’t make a dent in his annual cost. There’s his maintenance as well as the research loss due to the drain he’s causing on our other projects.”
“That’s not fair — adding in the cost of other projects’ delays.”
“It is fair. If you were still on the robotic law feasibility project, we’d have completed it by now.”
“Hah! That one’s a dead end. HARLIE’s existence proves it.”
“True, but we might have realized it earlier. And cheaper. Every project we have has to be weighed against every other.” Dome puffed at his cigar. The air was heavy with its smoke. “Anyway, we’re off the track. We can’t allow that danger, that HARLIE is a legal human being. We can’t even afford to be taken to court on this — we’d have to disclose our schematics — which would be just what our competitors want. And that’s a human schematic, isn’t it? The court would be asked to determine just what it is that makes a human being. If they decide it’s his mental ability or brain pattern — well, I’m sure DataCo or InterBem would just love to tie us up with a few lawsuits, the kind that drag on for years — anything to keep us from producing judgment circuits. Do you want to be sued for slaveholding?”
“I think you’re worrying about a longshot,” Auberson scoffed.
“That’s my job. I’m responsible to the stockholders of this corporation. I have to protect their investment. Right now I’m acting President, and I’m concerned about a six and a half million dollar bite on my budget.” Dome had been acting President for six months now — the Board of Directors couldn’t agree on any one person long enough to hire him. And besides, the rumor went, they were just as happy to run the company themselves — which was one of the reasons why the HARLIE project was in trouble. HARLIE had been authorized by a far-sighted president and approved by a far more liberal board of directors than the present one. Now, less than three years later, the inheritors of the project were having doubts. The market had changed, they said — conditions were different, competition was stiff, and there wasn’t enough money to finance this kind of research. What they really meant was, “It wasn’t our idea, so why should we have to pay the dues on it?”
Dome was saying, “If the other companies found out what we were trying to do with HARLIE, we’d lose all advantage in building him. The legal considerations alone are terrifying. For instance, if he were somehow declared legally human, he would be an annual bite on the budget with no way to discontinue it short of murder. The possibility exists for a permanent financial drain on this company that would effectively stifle all future growth potential of this division. Hell, it would destroy this division. We might have to take a bath on the HARLIE project, but it would be preferable to the financial shackles that could be put on us. We have to be prepared for the possibility. There’s two things we can do about it. One—” he ticked off on his finger — “we can turn him off now.”
Auberson started to protest, but Dome cut him off. “Hear me out, Auberson. I know all the reasons why we want to continue the HARLIE project — but let’s consider the other side. Two—” he ticked off another finger — “we get some kind of guarantee now that HARLIE is not legally human.”
Auberson stared in disbelief. “You really are taking this seriously, aren’t you?”
“Shouldn’t I? You know a corporation is a legal individual, don’t you? And a corporation only exists on paper. Compare that with HARLIE. It wouldn’t be that hard to prove he’s human, would it?”
Auberson had to agree. He was already thinking of ways he could do it.
“If only a few of you scientists got together and testified…” Dome left the sentence unfinished. “Hell, what’s that famous test you’re always talking about?”
“Uh, Turing’s typewriter in a room. If you can sit down at a typing machine and carry on a conversation with it and not be able to tell who’s on the other end, a machine or a person, then that computer is effectively sentient. Human.”
“And HARLIE could pass that test, couldn’t he?”
“Undoubtedly.” Abruptly, Auberson remembered the spinster librarian. “In fact, he already has.”
“Mm. Then we have to do something about that, don’t we?”
“Do we?”
Dome didn’t say anything. He picked up the single sheet of paper that had been lying in front of him and shoved it at the psychologist.
Auberson took it and read. The language was quite clear; the intent was immediate. There were no legal phrases that he could not understand.
I hereby affirm that the machine designated HARLIE (acronym for HUMAN ANALOGUE ROBOT, LIFE INPUT EQUIVALENTS) is only a programmed judgment-circuit computer. It is not now, never has been, and in no way ever can be a rational, intelligent, or “thinking” individual. The designation “human” cannot be used to describe HARLIE or its mental processes. The machine is a human-thought-simulating device only, not human in itself and cannot be considered such by any current known definition of the qualities and criteria which determine humanity, the presence or condition thereof.
SIGNE>>
Auberson grinned and threw it back on the desk. “You’ve got to be kidding. Who’s going to sign that?”
“You are, for one.”
“Oh no.” Auberson shook his head. “Not me. I know better. Besides, even if I did, it wouldn’t change the fact that HARLIE is human.”
“In the eyes of the law it would.”
Auberson shook his head again. “Uh uh — I don’t like it. It’s kind of Orwellian. It’s like declaring someone a non-person so that it’s all right to murder him.”
Dome puffed patiently at his cigar, waited till Auberson was through. “We’re only concerned about the legality of the situation, Auberson.”
Auberson felt himself digging in his heels. “That’s what Hitler said as he packed the German courts with his own judges.”
“I don’t like that insinuation, Aubie…” Dome’s voice was too controlled.
“It’s no insinuation. I’ll come right out and say it—”
“Aw, now look, Aubie—” Dome had changed his tone. His cigar lay unnoticed in the ashtray and he leaned forward like a Dutch uncle. “—You know I’m behind you all the way on the HARLIE project—”