After writing a post on how LLMs answer math questions (tl;dr: answering math questions is not the same as doing math), I found this post by Gary Marcus on the topic. The chart he created of expected results from a calculator cracked me up (screenshot here).