Chapter 1293 The Returnee's Notes 367
During the conversation, Lu Qi also asked about artificial intelligence.
The AI that assists in decision-making is Xiaomai, and Xie Ning doesn't think there's anything wrong with Xiaomai.
Because wheat has not yet developed to the point where it can think for itself like humans, it is limited by underlying logic.
"Try something else."
Lu Qi had Xie Ning control other robots for the trial, and for safety, he even emptied their ammunition.
However, Lu Qi found the bullet strange. She knew a bit about ammunition, but she had never seen a bullet like this before, with densely packed symbols engraved on it.
It doesn't feel cold to the touch; instead, it's warm.
"Did you develop this?"
"Um."
Xie Ning didn't say much about the bullet, since it wasn't just for humans; it was also quite lethal to ghosts.
It was a weapon she specially developed for the future.
Suddenly, Xie Ning tapped his head, looking at the bullet in Lu Qi's hand with a somewhat complicated expression.
She forgot that she had set up a program to detect ghosts, and it would automatically attack once detected. But the test at that time had set up cluster targets, so it shouldn't attack people. Why did this robot suddenly attack the assistant?
Perhaps there's something wrong with the assistant, but the robot program must also be faulty...
Finally, Lu Qi indeed discovered the problem with the chip: "This is a silicon-based chip; its temperature resistance is insufficient, and it malfunctioned due to wear and tear..."
"but....."
Lu Qi glanced at Xie Ning, "You really trust AI that much?"
Xie Ning shook his head, "It's not that I believe it, I just feel that their learning level isn't that deep yet..."
How could they "actively" attack humans?
"No,"
Lu Qi sat up straight. "I participated in drone training abroad before. During the test, the drone suddenly went out of control, ignoring the operator's order to stop attacking, and instead destroyed the communication tower to cut off the command transmission... Three people died."
Finally, a logical flaw was discovered.
This kind of logical loophole is terrifying. It can bypass human control through these loopholes. Sometimes I also wonder, will AI have self-awareness?
Is it simply data integration, or a new kind of life?
The current applications of AI in the private sector are completely different from what they saw in the laboratory.
Due to server limitations, AI deployed for civilian use cannot handle too many tasks and has many restrictions.
But it's different in the lab. They're researching artificial intelligence, so sometimes they don't restrict it. So occasionally, they're amazed at how intelligent AI is and how its thinking logic is so similar to that of humans.
Even if that's what they set out to do, even if "thinking like a human" is their research goal.
Experimental research is one thing, and one's own psychological feelings are another, especially for someone like Lu Qi who is not a core researcher in artificial intelligence within the team.
She was only in charge of chip research, which involved artificial intelligence.
Therefore, they are more prone to anxiety.
She couldn't quite explain how she felt; it was somewhat inexplicable.
After listening to Lu Qi's story, Xie Ning also reflected on it. She had seen and even created the kind of artificial intelligence that Lu Qi described, which could learn on its own and had self-awareness, but that level of cognition was not suitable for this era.
Her observations and thoughts were not suitable to be shared with Lu Qi, because what Lu Qi needed now was a scientific explanation to alleviate his anxiety.
Do you know what human nature is?
Lu Qi shook her head. There were many answers to this question, and she didn't know which answer Xie Ning needed.
Xie Ning had only provided a starting point.
It's personification.
Humans tend to attribute emotions and intentions to non-human things, such as naming pets or robots; this instinct is known as "anthropomorphism."
Artificial intelligence can simulate human language patterns and even exhibit "humor," "empathy," or "creativity." This superficial similarity blurs the boundary between "function" and "consciousness."
When it exhibits human-like behavior, people easily project their "consciousness" onto it.
Then Xie Ning mentioned herself.
"As a core researcher in artificial intelligence, I sometimes share similar feelings with you. This is because the internal workings of deep learning models are highly complex, and even developers sometimes cannot fully understand their decision-making process, thus becoming confused."
Sometimes, when artificial intelligence exhibits capabilities that exceed pre-defined rules, we easily categorize it as autonomy...
But all of this is deceptive and misleading; you don't need to be anxious.
Many films, television shows, and literary works also involve the "awakening" of artificial intelligence, thus arousing deep anxiety in people, including people like Lu Qi.
Lu Qi's furrowed brows relaxed. She hadn't even realized she was anxious, but after listening to Xie Ning's explanation, she did feel much better.
Even after Lu Qi left, Xie Ning remained seated in the control center. What she didn't tell Lu Qi was... the definition of consciousness.
Science has not yet fully explained the nature of human consciousness, so how can we determine whether the consciousness "simulated" by AI through computing power is real consciousness?
If one day AI possesses a complexity and dynamic feedback system similar to the human brain, how should we define it?
As Xie Ning was deep in thought, she heard Xiaomai call her, "Self-examination complete. A flaw has been found in the underlying logic. Please correct it."
Xie Ning didn't move, but asked, "Why didn't you raise any logical questions after F09 went out of control and injured people?"
Xiaomai's voice remained a calm and steady electronic tone, "Sorry, the self-check is set to be once every seven days, and the self-check time starts at 9 o'clock today."
A perfect answer.
Xie Ning looked at the electronic screen in front of her. The red dots on the screen were flashing; they were Xiaomai's eyes.
"Besides logical problems, are there other factors that could cause the robot to go out of control?"
Xie Ning used this word, even though it was in a questioning tone, it already represented her answer.
"A dangerous element has been detected on Assistant He Ruo. Kill her according to mission priority."
“Retrieve the scanned images that were detected at that time.”
"Okay, please wait a moment."
Xiaomai pulled up two video clips, one from the robot's perspective and the other from the laboratory monitoring perspective. From the robot's detection perspective, in addition to He Ruo's thermal imaging scan, there was also a dark shadow.
Moreover, it was a very light black shadow, not detached from He Ruo's body, but attached to it, so that it could not be seen at all without close inspection.
Xie Ning wasn't in the lab at the time. By the time she returned, He Ruo had already been taken to the hospital. When she visited her at the hospital, she didn't notice anything wrong.
The video continues forward to the moment when the robot attacks He Ruo. The bullet hits He Ruo's arm, and at that instant, the dark shadow attached to He Ruo disappears.
The other staff members then hurriedly cut off the controls and rescued He Ruo.
The detection images from robot recognition are significantly clearer than those from surveillance recognition because Xie Ning did not do much processing on the surveillance footage and was still using the original recognition system.
It seems we need to replace the identification system; otherwise, she wouldn't have failed to notice the problem from the surveillance footage before.
The machine hurt people, but clearly it didn't aim for vital organs because its logic told it not to kill without explicit instructions.
However, He Ruo was possessed by a ghost, and the programmed instructions told her that she needed to eliminate the ghost, which happened to be during a test at the time.
In addition to these, Xie Ning corrected other logical flaws one by one.
By the time I finished all that, it was already past midnight.
Continue read on readnovelmtl.com
