LLMs are Bad at Math

LLMs are Bad at Math

LLMs are known to struggle with math. Not in those PhD level tasks from AIME eval, where the reasoning models compete and shine... But rather in the everyday math we deal with - additions, multiplications, etc. Take for example Grok 3's DeepSearch where I prompted it to "... list countries by their GDP per capita in Japanese Yen". As you can see in the screenshot below, the agent did it most reasonably - found a readily available GDP per capita …