Of course we do if we're doing a full lifecycle analysis.
Let's assume a Golf / ID3 sized car doing 120k miles over their lives with several owners before they are recycled.
Combustion car @ 40mpg
Manufacturing CO2 - 12,000kg
Fuelling CO2 - 42,360kg
Lifetime emissions = 54,360kg or 450g CO2 per mile
EV @ 3.5 miles/kwh
Manufacturing CO2 - 14,500kg
Fuelling CO2 - 2,640kg
Charging losses (approx 5%) = 132kg
Lifetime emissions = 17,272kg or 143g CO2 per mile
This doesn't include the point that the carbon intensity of the electricity will improve over it's life, reduced servicing needs for the EV (oil etc), and also doesn't include the other emissions from the combustion car that contribute to poor air quality (e.g. CO, NOx etc..)
The EV battery can be reused once it's finished in the car, then ultimately recycled and used in a new vehicle.