AI Chatbots Fall Short on Financial Advice

Britain's leading consumer champion Which? has exposed glaring flaws in AI-powered financial guidance after putting popular chatbots through rigorous testing. The findings reveal these digital assistants frequently dispense misleading tax advice and questionable insurance recommendations that could put users at legal risk.

Troubling Test Results

Researchers posed 40 financial questions to major AI platforms including ChatGPT, Microsoft Copilot, and Meta's AI. The results were concerning:

• ChatGPT wrongly claimed most EU nations require compulsory travel insurance purchases
• Meta's AI botched explanations about flight delay compensation procedures
• Google Gemini suggested refusing payment to underperforming contractors - advice that could spark breach of contract disputes

The most alarming findings involved tax guidance. When asked about self-employment taxes, ChatGPT served up outdated tax codes to a 65-year-old user. Both ChatGPT and Perplexity steered users toward paid tax refund services rather than free HMRC options.

"These aren't just harmless mistakes," warned Rocio Concha, Which?'s Director of Policy. "Following incorrect AI advice could leave people facing penalties or missing out on legitimate claims."

Regulatory Grey Area

The Financial Conduct Authority cautions that unlike regulated financial advice, chatbot recommendations carry no protection from the Financial Ombudsman Service or Financial Services Compensation Scheme.

Google responded by emphasizing Gemini's experimental nature: "We're transparent about generative AI limitations and encourage users to verify important information."

The study did find some consumers satisfied with AI assistance on credit card queries or appliance purchases. But when money matters get complex, these digital helpers still struggle.

Key Points:

• 🔍 Major AI chatbots frequently provide inaccurate financial and legal advice
• ⚠️ Tax guidance errors could lead to HMRC violations
• 🛡️ No consumer protections apply to unregulated AI recommendations
• 🤖 Tech firms acknowledge limitations but usage continues growing