Too much drought can slow down growth and cause young fruits to fall. Water your okra regularly to avoid slowing down its growth. Get rid of weeds. Nourish okra crops by periodically applying a little compost, well-rotted manure or litter around the base of each okra plant.