The park has scenic views of the turquoise waters of Lake Michigan ... Point County Park is famous for its hidden caves and unique rock formations, most of which are visible only from the water.