To remove duplicates, import in a database and make a simple unique index or group-by query.
to check adresses, I've written a mass mailer program, I would send a test eMail to each address with a return-address hosted by me. then one week later collecting via pop3 the mailerdeamons autoreplies with "550" codes (bad account on this server)