Ask AI “what’s the biggest pay gap?” and it’ll miss negative numbers. Ask for “the company” with the top score and it’ll ignore ties. Paul Bradshaw tested ChatGPT, Claude, Gemini, and Copilot for data analysis – and catalogues where tools trip up. (Medium)
Summary
- AI tools can be a useful tool for data analysis, but results depend heavily on the context provided and the likelihood of flawed calculations, so code needs checking.
- If you don't understand code and don't want to learn, don't do data analysis with AI - the results may be inaccurate.
- Always check if the AI has used code to perform the analysis, as without code the results are likely to be wrong.
