Major banks and most public schools, colleges and universities will also take the day off. Is the post office open on Labor Day? Will mail be delivered? FedEx, UPS, and the U.S. Postal Service ...