Forget about suffering through a freezing shower! If your water heater ’s pilot light is out, check for relighting instructions fastened to the appliance, or look on the manufacturer’s website.