I can't remember the place names now (we did do the Medina), but wifey & I spent 10 days in Morocco albeit a decade ago. We started off with 3 days in Marrakesh, absolutely loved it, we were lucky enough to have a suite though in a beautiful hotel on the outskirts of the city to get away from the hustle & bustle if needed.
We had a rental car too and used that to drive to the hotel we had booked in the foothills of the Atlas Mountains for the rest of the trip. Did a lot of driving around and sightseeing, just had a wonderful time full-stop and would gladly go again.
If you have a basic command of French, it helps imo, but everyone we came across was polite and courteous.