I own both consoles so no bias here, but if you look at the DF video, particularly at 10:37 on and compare the difference, we're not just talking about a couple of frames here. There's a clear difference in image quality - for example the car lights on the XSX version are octagons compared to round on the PS5 version, it's really bizarre. Then in the few seconds after, the difference in image quality on the road is very noticeable indeed and at other points there's noticeable difference in grass details etc.
Something strange is going on for sure as there's no way the XSX version should look that poor in comparison. A couple of fps here and there is obviously no big deal, but when we're talking large differences in detail settings too, it just makes it weird. Hopefully this is something that can be fixed with a patch but if not, I'm sure it'll be a problem that's relatively short lived with future titles as devs get more experience with the dev tools.
With all that said though, the video highlights clear image quality differences, but I doubt most people would think anything of it if they're just playing the game and enjoying it for what it is on whatever system.