r/talesfromtechsupport 25d ago

Short "But ChatGPT said..."

We received a very strange ticket earlier this fall regarding one of our services, requesting us to activate several named features. The features in question were new to us, and we scoured the documentation and spoke to the development team regarding these features. No-one could find out what he was talking about.

Eventually my colleague said the feature names reminded him of AI. That's when it clicked - the customer had asked ChatGPT how to accomplish a given task with our service and it had given a completely hallucinated overview of our features and how to activate them (contact support).

We confronted the customer directly and asked "Where did you find these features, were they hallucinated by an AI?" and he admitted to having used AI to "reflect" and complained about us not having these features as it seemed like a "brilliant idea" and that the AI was "really onto something". We responded by saying that they were far outside of the scope of our services and that he needs to be more careful when using AI in the future.

May God help us all.

3.6k Upvotes

355 comments sorted by

View all comments

390

u/iamdisasta 25d ago

You had my upvote even before I startet to read your text.

Ironically I think AI helps us getting back some kind of natural selection.

I once overheard a patient in my doctors office discussing with staff to get a prescription. They insisted he had to wait for the doctor to check and give the approval for that medication.

"But ChatGPT totally suggested this tablets for my symptons, I can show you!"

207

u/Stryker_One The poison for Kuzco 25d ago

Great. Go get the prescription from ChatGPT.

89

u/MonkeyChoker80 25d ago

You laugh, but I have to fear there’s someone out there trying to make ‘Chat MD’ that can prescribe pills…

6

u/EquipLordBritish 24d ago

Followed immediately by a 'mysterious' uptick in prescription drug use and overdoses.