It'll change the dispersion pattern a bit due to diffraction, but that shouldn't cause too many issues unless you're listening well off-axis.
The only real concerns would be how you intend to finish up to the speaker and what happens in the future if it needs to be repaired/replaced. I can't imagine it'll be so happy surrounded by wet plaster, and that might not help its longevity.