How to remove duplicates from 10 million phone # records

[slangsomecash]

Hello,

I simply cannot, for the life of me, figure this out.

Could anyone point me in the right direction?

All of the data is in a single column. The data only contains phone numbers.

 

[Marc L]

Hello, try the Excel feature 'Remove Duplicates' from Data menu …​

​

 

[slangsomecash]

That makes sense.

Now, how do I do that for 10 million records spread out over 10 separate sheets? Obviously "Remove Duplicates" is insufficient for this project, as it does not dedupe across separate sheets (Excel can only hold 1.02MM rows per sheet).

 

[Chihiro]

If you have access to Power Query. Load all data to PQ. Then append all tables into one. Then perform remove duplicates.

Then count rows of the resulting table. If more than 1mil. Split them into 1 mil row tables each (using Index column and Table.SelectRows). And return them to worksheet.

 

[Marc L]

Or just using obviously any database software rather than Excel …​

​