@Braiam GPT-4 often does a better job than plain ChatGPT-3.5, but it still has the same flaws intrinsic to GPT, so (for example), as you noted earlier, it can explain the method needed to solve a problem even though it is incapable of actually using that method. In my jigsaw analogy, that happens because it doesn't know what the words on the jigsaw mean, they're just pretty patterns. Here's a recent example of GPT-4 saying clever-sounding nonsense about matrices.
scottaaronson.blog/?p=7209#comment-1949083 —
PM 2Ring 4 hours ago