I have a couple of friends who swear by silk liner gloves under your least-worst glove of choice for the conditions
See it's my understanding that silk is inferior to merino for liner gloves. Admittedly, I don't have any silk liners to compare at the moment but I already use the Rapha merino liner with the Rapha DW.