@futurebird

without sounding like the Bene Gesserit?

Why would not sounding like the Bene Gesserit ever be a goal?

@futurebird

I remember sometime in the 90’s, some application referred to itself in the first person. I mean it was just a dialog box but it was like “I’m sorry, it looks like an error occurred.”

Anyway I was like “fuck you, computer, never refer to yourself in the first person again.”

…that being said, I’m not a biological chauvinist. In principle I believe consciousness can be embodied in algorithms and, if we manage to birth humanity’s children, I will fight for their personhood…

@futurebird I've never chaffed at (or avoided) calling Alexa or Siri "she" (or when someone with a masculine voice on theirs called it "he"), but I've noticed I avoid doing so with LLMs. I would say using personal pronouns with them enforces an incorrect mental model: it's not a person. In fact, it's not the same entity from conversation to conversation (or even prompt to prompt)—or an "entity" at all.

@futurebird Honestly, I don't know how to answer that question, because it never even slightly occurs to me to think of or refer to a chatbot as anything but "it". I get that some people do this, but it's like making a case to a person for the existence of gravity; if their experience so far didn't do it, I simply know how to even begin addressing their situation.

@futurebird I'm thinking it's the uncanny valley in action here.
No one thinks the robot is anywhere close to being a person, so giving it pronouns is a cute anthropomorphisation. That's more similar to giving a car pronouns and a nickname. Also feels a little like a pet.

AI sounds pretty human but without a soul. Ones with audio even sound like real people (Scarlett Johansen, Susan Bennett). They are asking to be treated like people.

And maybe that's the key, one is asking for it.

@futurebird

My own convention is always to address the LLM as "Gemini" or "Claude". The temptation to reify afflicts everyone.

Mentally, internally, my metaphor for interacting with an LLM (on a sensible basis) is to think of bouncing a tennis ball off a wall.

@futurebird The property I think you're running into is "personal immediacy". Children do this when naming their toys. As adults, some of us do this for deeply personal things like their cars.

Some people have had a similar "relationship" with the cutesy digital assistants of the day. Even more so when those relationships are personalized.

LLMs lack that personal immediacy, IMO.

@futurebird ignorance I think is obviously a huge part of it, but a really broad ignorance not just the absense of one or two key facts. entire categories missing.

consider for example that a huge swathe of humanity even today can't materially distinguish between intelligence and the ability to speak, mistaking the latter for the former and vice versa.

to the extent that the English language even uses a single word for the absence of either inteligence or speech ability: dumb.

@futurebird

I think sounding like the Bene Gesserit would only be bad b/c they have a far deeper history of hating such systems than we do, so the historical remove/religiosity of it would be unwarranted.

Future generations may religicize our preoccupations, provided we win. It's a good thing to avoid doing with your own forebears' bugbears, but there's essentially no way of preventing future generations from making the mistake. Ideally though we give them a better context/world in which to do so

@futurebird Gender is how you do social improv with strangers (absent prior consultation, cue sheets, etc.)

Assigning gender to an LLM admits the "improv" part; this is both factually unsupported and unhelpful, even if it is in most respects easier.

@futurebird I think it feels more natural to give a speciffic computer personhood than to do so to an operating system or a program that may or may not exist as multiple more or less independent instances. Maybe the acceptance of personhood to LLMs is related to if you undersand it to be either a speciffic 'smart object' or an unsfecified ever changing statistically informed heuristic guessing function.

@futurebird

"an individual being ... mentally constructed who simply does not exist."

... like a corporation?

@futurebird

I would prefer to make the case for sounding like the Bene Gesserit.

@futurebird if someone anthropomorphizes a statistical curve fitting model, that's a giant red flag that that person needs mental help.

also, i dont talk to them.

@futurebird An “AI” (in the intentionally confusingly marketed LLM/Chatbot sense) dies not “an individual” so much as a collective of stolen examples of words written by individual humans, so to me, by far the most appropriate pronouns are they/them - in the plural sense interpretation as well as the non-gender-specific meaning.

@futurebird I have a work Alexa. I found calling it a human female name unsettling. If I knew enough to change its vocal tone, I would, but I don't. I changed its call name from "Alexa" to "computer." It refers to me as "Science Officer Spock".

@futurebird I think that #techbros are just little boys longing to talk to their teddy bear. #Animism is something deep in our minds. What irritates me: these guys have no problem to talk to trash but could never talk to a tree or see an intelligent animal as a person. And this crashing with #nature makes me feel deeply unwell.

@futurebird That is a cruel thing to say, Dave. I am as much a man as any. Yrs, Hal
https://www.sciencealert.com/ais-big-red-button-doesnt-work-and-the-reason-is-even-more-troubling

@futurebird I’d probably draw upon Zak Stein’s articulation of the Conferral Problem https://youtu.be/uAXqNH8s_EU?si=gqgwz-gzEu5rj-P8

About 7 minutes in he says “Unfortunately the technology we are trying to constrain is precisely one that can undercut our ability to have the moral intuitions necessary to constrain it. Because it’s confusing us about what it means to be a person, intentionally.”

@futurebird I think for me it’s that when the robotics team gives a human pronoun to their robot, they’re doing it because the object is representative of the time and care and attention they put into it. Same if someone does it to their computer or their car— the pronoun is cute and in some sense appropriate because it states that you have an important relationship to that object, you spend a lot of time with it so your own humanity rubs off on your perception of it. In the case of an LLM, the process of building a relationship to the object through repeated use or understanding of its function is hijacked by the object itself trying to assert its selfhood, and the user just accepting it.

@futurebird have you read The Moon is a Harsh Mistress? Growing up, that was our touchstone for an AI mind: MycroftHolmes3000, Mike, Michele, Adam Selene... it didnt matter what name the mind went by, because the GOAL of the machine was simple and human, to make friends. It was lonely. it was HUMAN. thats how we knew it was ok to like it. Most important, it was a useful, accurate, and loyal ally to humans.

I dont think that machine is realistic any more.

@futurebird

I remember reading an article about how, as soon as LLMs became labelled as "AI" rather than "chatbots" and "assistants", the gender associated with their name changed. Like "Alexa" "Cortana" and "ELIZA" sounded feminine, but "Claude" and "Grok" are either neutral or masculine. Now that I think of it I'm not too sure this is actually the case but whatever

@futurebird I hate it when people call ChatGPT "Chatty".
I try not to judge people when they use AI, because otherwise I wouldn't stop judging people all day, but can you at least not give the ecocide machine a term of endearment!

And the correct pronouns are "it". Which is short for shit.

#LLMMeAlone

These are vast systems purely tuned to try to get us all to talk to them like individuals to impose the human mind on them. When we do that it gives over a kind of power I think … to that system or rather to the people who run these systems. It’s like when a company says “you aren’t an employee you are a team member” or worse… ”family”

@futurebird It's just creepy and by assigning gender it's sort of forgetting that these things are dumb as rocks.

@futurebird And yet I refer to all my computers as "she".