If you shave or pluck your body hair, especially with an epilator, you probably have some ingrown hairs.
To prevent epilated hair from growing into skin, get a natural bristle showering brush. Brush the areas prior to each shave. This should remove dead skin. Next time you’re taking a shower, brush then shaven areas once again. This should raise the hairs, preventing them from growing in.
Continue to do this, and in time the hairs will easily protrude the skin and will never grown in again. Added bonus: the skin in those areas will become even softer and pleasant to touch.