Once the caulk is fully cured (which could be several days, depending on the type), trim it even with the siding with a razor blade. To avoid making holes in the first place, use vinyl siding ...