A man has been arrested in connection with the theft on Easter Sunday of Homeland Secretary Kristi Noem’s handbag, CNN reported, citing an unidentified law-enforcement source.