Water bills in the Madison County village will have a water non-compliance advisory but drinking water is OK the mayor says.