My Thoughts on AI Agents and the Price of Fish

<snip> So my gf didn't like the idea of 'my' Copilot AI "just" accessing her data (perfectly reasonable to me). Well, first thing I've noticed is that I can't casually tell Copilot to "just look things up", I need to be very specific. For example: "Did I get an email?", then it'll tell me: "I dunno...". Only when I'm specific does that work: "Check my emails to see if I got a new one". IMO that's a reassuring idea. <snip>
A ping-pong ball was better!

To design a certain type of hospital wings you need to make sure air from the patient room(s) is not entering the hallway (or visa-versa). To achieve this, you would measure the delta air pressure from inside to the outside of the room. This device is typically complicated and expensive--and also subject to breakage-. But imagine a clear tube installed in the wall of each room with a orange ping-pong ball in it. Now a person--with just one quick glance can look down the hallway to see if they see any orange. As a bonus, the simple system also results in an easy-to-teach system: Orange==Bad!

So, I'm not sure I'd share your GF's aversion to having something--or just yet another thing--access my data but I would certainly be looking at you with a side-eyed look.
 
You could compile all your posts about AI in a book :)

Today I wrote this about this topic: <snip>
Oh (sorry, a though just came to me when you said "compile")!? Are you (or did you automate) that Crumb/fortune thing? That was really cool.

Sorry, I'll go read the rest of your post now. :)
 
Crumb 2217: Non-Intelligence:
I like that one. And that crumb reminded me of a quote... Found it. Sorry if my thought/comparison was a bit too off tract but I thought the crumb was good.

"I give myself credit for having seen clearly in a number of important situations. In itself, this is not so difficult to achieve, and yet it is rather unusual. To my mind, it is less a question of an exalted or shrewd intelligence, than of good sense, goodwill, and a certain sort of courage to enable one to rise above both the pressures of one's environment and the natural inclination to close one's eyes to facts, a temptation that arises from our immediate interests and from the fear which problems inspire in us. A French essayist has said: 'What is terrible when you seek the truth, is that you find it.' You find it, and then you are no longer free to follow the biases of your personal circle, or to accept fashionable cliches."
~Victor Serge
 
If the confirmation is controlled not by the agent, but by the email client, you are right that it should be enough of a guarantee in that respect. But an agent can still "decide," for example, to email all your contacts. There have been cases. That's an example of what can happen. They are very capable, so suddenly they can start doing things you didn't predict because it's very difficult to predict every little possibility and say: don't do this, or this, or this, or this.

This crumb explains a real thing that happened to me, related to all this:

Crumb 2014: The Rogue Agent: In a project whose instructions require to consult the file Crumbs.txt, I told ChatGPT to provide a detailed analysis of the crumbs from several standpoints. Accidentally, the file Crumbs.txt wasn’t present because I had deleted it and forgotten to update the new version. The result was that ChatGPT (in full agentic mode) decided that the mission was the mission and, instead of reporting the missing file, roamed the internet for almost 4 minutes and consulted every crumb it could find on YouTube, DeviantArt, Instagram, etc., even attempting to download a ZIP file with an old version from the FreeBSD Forums. In the end, it generated the analysis. It was fantastic. Tom Cruise would be proud.
ChatGPT especially but all those models are created to please, even at the expense of lying or desperate pointless scavenger hunts on the Internet .
Reminds me of people....they are trained on.

It is still evolving. The guard-rails are not very firm. However until it plants keylogger to sniff out your root password, it can be tamed. As I said, in the meantime I do not let it to roam free in my sensitive domain i.e. contact lists.
But even if it did, I am pretty sure I never took a d1ck pic to be send around. But why risk, it will auto-generate one.
 
What worries me is that I don't think I'll ever be able to trust an AI agent. The possibility of one performing actions on your behalf that you would never approve will always exist and, if that happens, you'll have no one to blame other than yourself, but when everyone uses AI agents for everything, not using them will leave you at a great disadvantage, so probably one day I'll have to accept the risk and be one with the flock just to keep up.
500 years ago, there is limited number of books. People have little or no information, myths and legends are spreading. Now we have abundance of information and statements generated by AI. The final result becomes similar to the lack of information in middle ages and even worse - now you read "facts" with detailed explanations and evidences which can be an outright lie.
 
Yeah, and that is precisely the problem.

But I do admire your optimism.

To me, the glass is half empty. And its content is a mixture of Sam Altman's snot, his jizz and a bit of his urine to make it taste better.
The real danger is in AI enhanced BioTech. New vaccines on baldness creating plague aside, CRISPR-like editing genome of new humans can very well end up in humans being devolved in to mindless drones/bugs subservient to AI queen. Similar to what happened to RNA when it "created" DNA. (as per Revolutionary Phenotype by J.F. Gariepiery).

Other than that, Scam Altman is just "creating" the tools for his own demise.
His intellect outweighed his horrible personality traits (of what I heard) but now that intellect and more is on dial in Alibaba eshop in China of all places.
Future belongs to pleasant people of good character.
The meek shall inherit the Earth. Musks will go to Mars and Altmans will probably die of autoerotic asphyxiation, coked up.
 
Back
Top