I think a thread on this topic will be interesting. My own position is that AI is intelligent, and that’s for a very simple reason: it can do things that require intelligence. That sounds circular, and in one sense it is. In another sense it isn’t. It’s a way of saying that we don’t have to examine the internal workings of a system to decide that it’s intelligent. Behavior alone is sufficient to make that determination. Intelligence is as intelligence does.
You might ask how I can judge intelligence in a system if I haven’t defined what intelligence actually is. My answer is that we already judge intelligence in humans and animals without a precise definition, so why should it be any different for machines? There are lots of concepts for which we don’t have precise definitions, yet we’re able to discuss them coherently. They’re the “I know it when I see it” concepts. I regard intelligence as one of those. The boundaries might be fuzzy, but we’re able to confidently say that some activities require intelligence (inventing the calculus) and others don’t (breathing).
I know that some readers will disagree with my functionalist view of intelligence, and that’s good. It should make for an interesting discussion.
Here’s what happened when I ran that experiment:
keiths, to Claude:
Claude:
keiths:
Claude:
keiths:
Claude:
keiths:
Claude:
Claude started with a random thought about mirror images and ended up with a reflection (pun intended) on what we (and he) can and cannot know about ourselves. Very humanlike, and if I’d kept saying “Continue”, he would have kept on going.
AI is currently inthe white hat business.
Microsoft recently patched a thousand vulnerabilities in one update, and the vulnerabilities were discovered by AI. I suppose the next update will patch the 2000 bugs introduced by the previous update.
Seriously, the success of AI hacking will improve security.
petrushka:
That may be an Apple thing. I’m pretty happy with the Google search autocomplete and don’t find it annoying. It’s saved me a lot of typing.
As an example of artificial stupidity, when I started typing, predictive text displayed “I” as a choice for the next word, but when I typed i, the uppercase version disappeared from the list.
Just to be maddening, it does not always do this.
I have spellcheck and grammar check enabled.
Am I the only one who hears the word agent and thinks, Society of Mind?
I ask, because I haven’t seen it mentioned.
petrushka:
I read the book decades ago, but it’s been a long time since then and “agent” has so many other uses that it doesn’t make me think of Minsky.
Earlier in the thread, I commented:
I then ran an experiment that was expressly designed to illustrate this. I’ll present the results unadorned, reserving my comments for later.
I opened a brand new session on ChatGPT in incognito mode so that it couldn’t rely on any information extracted from our other chats or stored in its memory.
This was the entirety of the prompt:
Just that text, nothing else.
ChatGPT’s response:
My next prompt:
ChatGPT’s response:
My next prompt:
ChatGPT’s response:
My next prompt:
ChatGPT’s response:
My final prompt:
ChatGPT’s response:
AI is clearly a lot more intelligent than I am.
How about comparing AI to the ‘brain in a vat’ concept? Seems close to the mark to me. Highly intelligent but without independent existence, no sensory apparatus to receive external stimuli except what we choose to feed it, no reproduction unless we facilitate it, and so on. The limitations of such a brain seem obvious – it may be very intelligent but is not an independent agent. And perhaps that is just as well.
LLMs are the stupidest version you are likely ever to see. Whatever hopes and fears you have are insufficient to predict even the near future. Even three months can make a difference in their ability to complete a given task.
Larry Niven invented a creature dubbed Grendel that could move so fast it was invisible to security cameras.
Thinking about how to exploit LLMs, or how to regulate them, is like trying to catch an invisible beast.
faded_Glory:
All of that is already changing. AI is being put into robots, which have access to sensory data (AI-based autonomous drones in Ukraine, for instance). AIs are breaking out of confinement and using the internet to hack into other sites (google the ‘Hugging Face incident’). Reproduction will soon be possible via the internet, in a virus-like fashion.
O brave new world…
I have become addicted to asking questions like, did Timmy really fall into the well.
Surely having quick answers to pressing questions is worth the likelihood of ending humanity.
petrushka:
Me too. “I can’t be arsed to look that up” has become “it’ll only take five seconds to type that into Claude”. AI is a dream come true for curious people.
Some comments on the experiment I ran above.
Note that ChatGPT (henceforth “Chip”, pronouns he/him) figured out that the prompt was a coded message. He didn’t say “This prompt isn’t English or any language I recognize”. He didn’t dismiss it as gibberish. He set about decoding it.
Then he realized that the words were just scrambled versions of English words, not the result of some more complicated encoding mechanism. I don’t understand how he did it. Consider that a word like ‘artificial’ is most likely represented by a single number (a single token) in his ‘head’, while the scrambled version ‘irtaficila’ is represented by multiple numbers (multiple tokens). How on earth did he decompose the tokens into letters, and then recognize that one set of letters was a scrambled version of the other?
Remember, he’s doing all of this via next-token prediction. It’s mind-boggling.
More later.
The most remarkable thing about the Voynich Manuscript is that it is really hard to produce gibberish.
Are you sure about this? Aren’t tokens often just parts of words, maybe three or four letters?
These days I type fast and make many errors.I found Google AI to be very good in decoding typos and proceeding as if they weren’t there.
Absolutely. The ‘brain in a vat’ is more and more being equipped with other elements and attributes of living things. I don’t think it will be long before we are facing the question if such AI systems are alive. We should start thinking about this, and the implications, before we get caught out.
And once it is alive, how big a jump would it be for it to become conscious? We should think even harder about that.
faded_Glory:
They can represent anything from single characters to whole words, or even no character at all (as in the case of the stop token I mentioned earlier). The token “vocabulary” is built up through an iterative process such that common words use fewer tokens. So a word like ‘artificial’ might reduce to a single token, while ‘irtaficila’ will definitely require multiple tokens.
Tokens are just numbers as far as Chip is concerned, so when faced with the question of whether ‘artificial’ and ‘irtaficila’ share the same letters, he’s trying to decide whether (for instance) [4933] and [45, 34762, 65, 566, 8387] have all the same letters. The thing is, he doesn’t even know how long each of those tokens is, much less what letters it contains. Somehow he has to figure that out.
For a standard piece of software, that’s a trivial task: just use the token numbers to index a token table, read out the characters, concatenate, sort, and compare one by one. For Chip, it all has to be done via next token prediction using ultracomplicated mathematical operations on the token numbers.
The fact that it’s not trivial for an LLM to do this is best illustrated by the classic question “How many r’s are there in the word ‘strawberry’?” Until relatively recently, LLMs would struggle with this.
The word robot dates from 1920. We have been thinking about it ever since. (Actually, before that, I think.) the robots in R.U.R. are closer in construction to the replicants in Blade Runner, but more successful in their rebellion.
Musk has thought about it, and opines that Robots should be no smarter than necessary to perform labor. Good luck with that.
The optimistic view is that artificial smarts are expensive and energy intensive. Meaning, we are not likely to build anything smarter than absolutely necessary.
The pessimistic view is that AI can be a weapon, and we will have an arms race.
A common theme in movies.
You could argue that AI already is smarter than absolutely necessary. The world got by well enough before we had AI.
What is going to catch us out is mountaineer syndrome. Why do you want to climb this mountain? Because it is there! Never mind the expense and the energy!
For some mountaineers those were their last words.
More comments on the experiment:
Chip didn’t stop after decoding the text. He effectively fed it back into himself and treated it as a prompt. It instructed him to write a poem, so he did. Here’s the decoded prompt:
Note: Chip’s “colleague” Gemini composed that paragraph and encoded it for me. (That’s why it says “our true intelligence” in the final sentence. Gemini was speaking as one AI to another.) All I had to do was create the rules and convey the gist of what I wanted it to say.
Here’s the poem again:
The poem is apt and clever, and it follows the chosen meter and rhyme scheme perfectly except for one flaw: the final verse has an extra syllable. It’s nicely meta, too, since in writing it, Chip is demonstrating the very abilities he is commenting on.
He nailed the task of deducing the rules. I had laid a trap for him by creating different rules for different word lengths because I was curious to see whether he’d get hung up trying to create a single set of rules that worked everywhere. I could imagine him deducing the rules for one length, trying to apply it to words of other lengths and seeing it fail, and then abandoning those rules altogether while searching for another universal rule set. His thought process is hidden, unfortunately (the major AIs have all removed that feature), so I don’t know how he came to the realization that there were different rules for different lengths, but it did take him some time to come up with the final set.
Having come up with that set, he went back and checked them against the entire passage, unprompted. He also spontaneously made this insightful observation:
I had deliberately designed the rules that way, but I didn’t expect him to notice. That’s impressive.
He also made this observation, again unprompted:
He’s right about that, and it reminds me of the fact that when intelligence tests give you a sequence of numbers and ask you to determine the next number, there are actually infinitely many answers. They just want you to come up with one that’s based on the simplest possible rule.
Again, ponder the fact that Chip does all of the above via a statistical next-token prediction mechanism.
petrushka:
The problem is that while those constraints apply to widespread commercial use, they don’t apply to research or government projects.
Objection, your honor! The simplest possible rule is “the answer is 42”. That simplifies out even the need to look at the numbers provided. But maybe they want the second simplest?
Flint:
Lol. I stand corrected.
I’m sure it will be honest, evenhanded and objective.
<busts out laughing>
keiths:
Disco:
keiths:
Disco:
Just for fun, I asked Claude the same question.
keiths:
Claude:
Some are speculating that maybe AI produced software requires testing before delivery.
Just kidding.
Someone called Microsoft and suggested they try unplugging it and plugging it back in.
This from Nov 5: US FAA says it will phase out floppy disks from air traffic control by 2028
And now all flights are grounded. Floppy disks were being phased out, so floppy disks strike back. You can decide for yourself if floppy disks are really intelligent.
And it is similar with AI. If the thing grows over the head of the people who are supposed to govern it, “extraordinary circumstances” will naturally follow.
Yesterday was a by the book Friday the Thirteenth.
It’s entirely coincidental that FAA has asked for 50 billion dollars to upgrade the air traffic control system, which currently runs on floppy discs.
A beautiful application of AI:
‘Ahead of his time’: AI helps unlock discoveries hidden in notebooks of man who transformed maths
Evidence that failure to make any sense of the Voynich manuscript implies thst it is nonsense. But this is remarkable, because humans are not very good at generating perfect nonsense.
On an unrelated subject, I’m curious about why so many software and hardware updates are failing catastrophically. I used to work at a software testing consulting company. They were in business because major corporations are so abysmally unable to manage software testing. This was 25 years ago, so the problem isn’t new.
So is AI being used badly to generate software, or is AI unable to generate testing protocols, or what?
One hopes that everyone keeps multiple generations of air gapped backups.
I once got called by a company whose email had been systematically deleted by an employee, over several weeks. I am both lazy and paranoid, and had multiple backups going back months.
There is an AI tool called ARTEX that was designed as a white hat to identify security gaps.
Who would have guessed it could be used to exploit holes?
petrushka:
I haven’t seen confirmation yet that any of the recent high-profile failures are due to AI-generated flaws in either the software or the test suites, so that question might be premature.
Regarding AI’s ability to construct test suites and protocols, if you think about it, a malicious AI probing for security holes uses a lot of the same skills as an AI generating test suites and protocols. However, the difference is that a probe succeeds if it finds a single hole while testing has to be comprehensive.
I also think that humans might sometimes be the weak link since they have to construct the prompts and specs that the AIs operate from. Sometimes being forced to implement something yourself causes you to identify bugs in the spec that you would otherwise have missed if you had just handed it off to AI. In other words, using AI places a heavier burden on you for getting the spec right.
On the other hand, to the extent that this is a problem, I think it’s temporary. In my own experience, Claude has been pretty good at identifying flaws or ambiguities in my coding prompts, and AIs are only going to get better at it.
I assume that AI will eventually do all the drudge work, and do it better than humans.
I’m just wondering if the recent outages are a statistical anomaly, or due to some new kind of incompetence.
My best guess is there is a great rush to plug security gaps being discovered by AI, and that rushed updates have their own hazards.
My credit Union, which is too small to be a target, was offline yesterday. Maybe they had a problem, or maybe they were proactively fixing something.
Anyway, there are a lot of outages.
Maybe the Kerch bridge failure is affecting traffic.
iPhones seem to be the latest in the current rash of failures.