Just been out to greenhouse to water mine - looked at one plant that is slow to fruit and found two nice chillies- touched one and it fell off - had a look and saw a hole - cut it open and got a grub in it - checked the other and that's got a hole in it - Checked all the rest and they seem OK.
Chilli (fruit) maggot/fly probably - same problem I had. Got more on the plant but will always get some if outdoors. My Trinidad has too many fruits.. the plants are too heavy now and in the wind the plants fall over, the Bhut stems snapped due to the weight of foliage too! Not used to the growth rate in the wild I suspect.