More than 180 people could exit the agency in coming weeks if they take Mayor John Whitmire's one-time retirement offer.