House Stark didn't always control the whole of the North. At one point, King's Landing wasn't on the map, etc. At one point, Westeros was in an era called the Age of the Hundred Kingdoms.