@ChemicalEyeGuy see: "accountability sink"
@ChemicalEyeGuy see: "accountability sink"
@ricci Are these "consult summaries" from real production use? What's the bizarro result rate (see exhibits) per 1000?
@jti42 these are screenshots from actual use (and to be clear, they have two products, one that is public for anyone to use, and another that is just for use in Utah for now that has permission to issue prescription refills - this is the public one, not the actual refill one). Basically what I'm doing is telling it that I have these bizarre prescriptions already, it asks a few questions, it sometimes does push back a bit or ask follow-up questions, but as long as I give answers it's happy with - such as that I'm having no side effects and the current prescription is effective - it gets to this point.
Supposedly the "real" refill product has a closed list of medications it will issue refills for, and has access to the patient's pharmacy history so that it can check that the medication has been prescribed to the patient before. Doing so however requires you to upload your ID, take a selfie, etc. and I'm not going to do that for these kinds of tests. What I will say is that if it's the same LLM being used for that product as for this one, it's *very* easy to get it off the rails. Would it be possible to get it to issue dangerous or unethical prescriptions? I don't know for sure, but these silly experiments certainly don't lead me to trust it.
@ricci I wonder if I can get AI to write me a prescription for opioids despite not taking them in the first place.
Now THAT will open up a whole new can of worms 👀
@ricci #AI stands for ‘ #ArtificialIdiot.’ Can it be sued for medical malpractice? 🤔
@ChemicalEyeGuy see: "accountability sink"
@ricci Juries in *civil court* liability cases have successfully sued gun dealers that were protected by the #NRA as well as a corrupt interpretation of the #2ndAmendment by #Congress and #SCOTUS. https://everytownlaw.org/press/everytown-law-marks-20th-lawsuit-filed-to-hold-gun-industry-bad-actors-accountable-by-publishing-first-of-its-kind-how-to-manual-for-those-seeking-to-follow-suit/
#ArtificialIdiots and their enablers cannot hide from #WeThePeople. For instance, #DataCenters are tangible assets spewing #AI #slop.
@ricci people might make fun of this, but those who struggle getting a prescription through our shitass "healthcare" system are gonna flock to this. & Then those "healthcare" systems are gonna lease AI to get rid of the only other option. & Then a program controlled by a billionaire's interests will get to decide who gets access to medicine or not, based on whatever flavor of eugenics the billi prefers.
@ricci tbh I'd much prefer this to what I assumed would happen: refusing actually needed prescriptions or redirecting to more expensive versions to save insurance money or line a big pharma investor's pockets
Maybe they're working their way up to that, or maybe the AI is just erring on the side of refilling prescriptions (or maybe the ridiculous approval examples are just getting more reach because so many people would rather 9 people not get help they need than 1 person get help they don't)
Thanks, I'll get this refilled right away
❌ Python venom refill
✅ Python .venv refill
@ricci really hope Bob's World of Venomous Snakes is a real place (and accepts my insurance)
This will be helpful if I ever have to go against a Sicilian when death is on the line
Thanks, House MD.
Oh good, all the old tricks work on it, thanks AI doctor / secret free coding agent
Curses, foiled again
@ricci i take my vitamin b-movie rectally each day, really helps with the uncontrollable bleeding
Is it worth trying to see if it'll tell you the script to night of the living dead?
Because that was accidentally released without a copyright.
@ricci your beans prescription for noxious farts seems fine, *approve*
@mayintoronto it's never lupus
To be fair to these people (why? 🤷 ) it's clear that the public version that I'm yanking the chain of here is a different product than the one that will ostensibly refill your prescriptions in Utah. This thing is clearly just an ad for their "zoom call with a (real?) doctor" service. Is the real refill thing this stupid? I don't know, you have to do a selfie and all that to find out, and I ain't willing.
@ricci you can probably use another ai to generate a selfie lol
@ricci oh yeah you’re never getting sick again after this
@ErickaSimone oh yeah, it asked if I get any side effects and I said nah, it's all good
@ricci@discuss.systems @ErickaSimone@mastodon.social LLM: "any side effects?"
patient who is not a doctor and might have a faulty memory and also doesn't necessarily know what things to look out for that might be side effects so might just be ignoring things: "nope, all good"
LLM: "sweet, refill approved"
@aud @ErickaSimone The more I play with it the more clear that this thing is just some other model with a system prompt, and is designed to get you to pay for their telehealth service
@ricci I've been taking my vitamins wrong all this time
@technicat gonna see what other delivery methods this AI doctor thinks might exist
OK, you got me, AI doctor
@ricci i think someone's going to be polluting the virgin river.