Its both, but aerodynamics is the larger impact at speed for sure. But yes for sure as speed goes up you will see far more effect from wind resistance etc. Physics also of course tells us that accelerating 10% more weight will require 10% more energy.
The problem is there are so many factors at play that the insignificant benefit from having slightly less fuel weight will disappear in our ability to measure it.
Car engine efficiency, not a straight line, plus doesn't start at zero unless we use stop start somehow perfectly
Aerodynamics as you say assuming pure car design here
Friction of eg tyres, transmission
But anyway if we go back to the worst case for us, where we are accelerating and adding energy, if 30kgs average extra weight. Lets take the lightest focus, 1322kg and add a lightweight driver of 60kg, giving us 1382 plus lets say a 18kg of fuel to nicely round us to 1400kgs. So if 30kg would top it up we would be 1430/1400 = 2.1% heavier and require 2.1% more energy usage.
So if we ignore any effect at all from anything other than accelerating and lets say we spend 25% of the time actually accelerating 25% of 2.1% is 0.5%. Hardly seems worth worrying about does it
Personally I hate petrol stations so the less frequently I nee to go to one its worth the miniscule impact on MPG. AND, I seem to get range worries now so I would struggle with only having 100miles range when I had just "filled up"