Thermal throttling. Prime is making your CPU hit it's top heat limit, so it's dropping it's speed in order to lower heat and stop your house melting.
Prime95 is not a good test. It's a very non-typical workload, and your motherboard will likely use some kind of overvoltage when running those speeds for stability. At normal clocks, that overvoltage will be absent, meaning Prime is not giving you an indication of stability at normal speeds.