Faster in terms of Latency? No.. Faster in terms of effective frequency - Yes?
As for capacity, the system will always perform better with more RAM. However, no matter how much RAM you have paging will still occur unless you specify the settings yourself, or you able to to turn paging off completely. I would only consider this with 8GB minimum.
In your scenario 8GB of CAS9 depending on the frequency