How to remove duplicates from a mailing list before you import it
Most newsletter tools charge by the number of contacts, so duplicates cost money. They also send the same person two copies, which is a quick way to an unsubscribe.
Exact duplicate emails are usually caught on import. The ones that slip through are the same person with a work and a personal address, or with dots and plus tags in a Gmail address.
Step by step
- Gather the lists
Export from every source you're combining: signup forms, events, old tools. Put them into one CSV or spreadsheet.
- Clean it
Open the file in Contact Dedup. Gmail addresses are compared without dots and plus tags (j.smith+news@gmail.com is the same inbox as jsmith@gmail.com), and people are matched across addresses using names and phones.
- Choose which address to keep
When a group is merged, all distinct emails are kept in the row. Decide which one to send to, usually the most recent or the personal one.
- Import
Import the cleaned file into your newsletter tool. Its own duplicate check will catch anything that's still an exact repeat.
Things to watch out for
- Don't merge on name alone. Two subscribers called Maria Garcia are probably two people.
- Keep the consent information from the original rows. If you merge, make sure the kept row still shows when and how the person subscribed.
Questions
Doesn't my newsletter tool remove duplicates already?
It removes identical email addresses. The same person with two different addresses gets two emails.
Is it safe to process subscriber data this way?
The list is processed in your browser and never uploaded, so it doesn't go to another company.
More guides
- What Contact Dedup understands, with examplesWhich pairs are the same person, and which are kept apart.
- How to remove duplicate contacts in Excel, including the ones Excel missesRemove Duplicates only catches identical rows. How to find the rest.
- How to find and merge duplicate contacts in a CSV fileWhat to compare, and how not to merge two different people.
- How to clean up duplicate contacts from your phone (vCard / .vcf)Export, merge without losing photos or notes, import back.
- How to dedupe a Google Contacts exportWhen Google's Merge & fix isn't enough.
- Cleaning duplicate contacts out of a CRM exportCustomer data, sales history and why you shouldn't upload it.
- How to find duplicate companies in a CRM or spreadsheetLegal forms, websites and branches in different cities.