My AI chatbot kept giving customers wrong refund amounts in Denver

Last Thursday I was testing our support bot before launch and it told a guy he was getting $214 back when the real total was $41. I had to pull the plug and spent 5 hours digging through the training data, turns out I fed it a spreadsheet with old pricing columns. Has anyone else had a model hallucinate numbers from bad source files, and how do you catch it before real users do?

2 comments

2 Comments

lewis.diana19d ago

Honestly, that's on you for trusting a bot with money stuff.

loganhart18d ago

Did you hear what happened to my buddy Rob? He let one of those finance bots handle his rent and it "invested" it in some crypto thing that tanked by Tuesday.