I'm using the Canon alongside the Fuji whilst making the decision, and for me there is a significant difference when you compare them in that way. On FF I like the 35, 50 & 85 lenses a lot. I also like those lenses (actual FF focal lengths not crop equivalent) on the Fuji (well it's 35, 56 & 90 on the Fuji, which are awesome).
Sorry for not being clear, I don't actually like 24mm on FF that much as a prime. So a 23mm on the Fuji isn't really doing it for me some of the time (I do think the Fuji 23 f1.4 is a nice lens). This is with regards to the lens characteristics, so how the out of focus areas render etc. On the crop the field of view changes to something close to a 35mm but it's still a cropped 23mm image so you still get 23mm lens characteristics. Hopefully that's a bit clearer? I just much prefer my Sigma 35mm on FF over the Fuji 23mm, I admit to shooting wide open a lot as well
Generally though I'm happy enough with the crop shot when viewed on its own. The 50-140 I kind of like, I just like my 70-200 mkII better. Today though the Canon gear bag was so much heavier when going to my folks for Christmas dinner than I've gotten used to with Fuji, tomorrow I'm going back with the Fuji and I know it's going to be so much lighter. This isn't going to be an easy decision for sure.
Edit: A couple of non gear considerations: working in Lightroom is much quicker with Canon despite a higher MP count. The Canon files are also easier to work with in Lightroom. I also find changing lenses much quicker with Canon, I always find the Fuji end caps "grab" the lens even though I have already loosened it ready for a quick change (my fat fingers seem to deal with larger lenses easier as well). Not massive issues, but this decision is going down to the wire!
Yup, I understand you .... if you really like shooting images with a shallow depth of field then APS-C will provide a slightly different rendering which can take some getting used to. As I've mentioned though, I don't care much for the very shallow depth of field look - I think it's overused, and for portraiture ( where very shallow depth of field tends to be most commonly used ) I actually prefer to shoot with a longer focal length eg. 200mm - the compression and subject isolation at those focal lengths make the debate between FF and APS-C rather moot.
Weight wise, sure is nice carrying a Fuji kit than a full-frame one. I still have my Nikon gear but it's not selected often over the Fuji. I agree with you on post-processing in Lightroom, though ... probably my main gripe with Fuji. I do find the files require a lot more care, particularly with sharpening, to avoid artifacts.