Extracting Unique, Duplicate and Missing Items using Formulas [spreadcheats]

Share

Facebook
Twitter
LinkedIn

Often I wish Microsoft had spent the effort and time on a data genie (and a set of powerful formulas) that can automate common data cleanup tasks like extracting duplicates, makings lists unique, find missing items, remove spaces etc. Alas, instead they have provided features like clippy which are intrusive to say the least.

So as part of our second installment of spreadcheats we will learn how to tackle few of the most common data processing tasks:

Getting Unique Items from a List of Cells

There are 3 simple ways to do this:

  1. Using Advanced Data Filter
  2. Using countif() and auto filter
  3. Using formulas as described here

Assuming you have data as shown in the picture aside (and wishing you will have customers like those):

  • First add a column to the left of the list. Here we will use formulas to fill numbers based on the uniqueness of the cell next to it.
  • Essentially our formula should generate numbers in increasing order as long as the corresponding item is unique and not increase the number otherwise.
  • So the formula for order column can be like this: =IF(COUNTIF(list-upto-that-point, current element)=1,previous-order+1, previous-order)
    See the example below:

    remember, the first cell order is 1.
  • See how we are using both absolute and relative references to fetch the counts.
  • Now add another column to the right of the list, here we will fetch unique items.
  • We will use vlookup() to fetch each of the 12 unique items. The formula goes like this:
    =VLOOKUP(running number,$B$4:$C$22,2,FALSE)
    You can wrap the vlookup() with if() formula to avoid seeing #value errors.

That is all. Using this method you can extract unique items froma list.

Eliminating Doubles from a List

There are 2 ways in which you can find and remove duplicates(doubles) in excel lists with ease:

  1. Using countif() and then auto-filter
  2. Using formulas

The process for finding duplicates using formulas is same as that of finding unique items.

Instead of writing COUNTIF(list-upto-that-point, current element)=1, we now write COUNTIF(list-upto-that-point, current element)=2. Also the first element’s count should be changed to zero.

Once done the list should look like what you see on the side.

Finding Missing Items by comparing one list with another:

Even though this might seem like a different challenge, it is infact same as the above techniques. You need to use countif() to compare first list’s elements with second list. How? that is your home work.

Download and see these formulas in action:

Still having some doubts? Download the excel tutorial – unique & duplicate items and learn by poking around.

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

23 Responses to “Learn Top 10 Excel Features”

  1. Dwi Budi H says:

    What it looks like if excel without formula?? 🙂

    • philip says:

      It would be not excel it would just be fancy tables in which you could just use power point. (Chandoo) would Access be an alternative?

  2. Roy says:

    Awesome piece of work!!!

  3. Rich says:

    Great article.

    Chandoo - my biggest interest in the article was the awesome word-graphic at the top - where did you go to get it done into a shape?

  4. koushik says:

    Awesome Chandoo.. You need always needs coffee to start up with. BTW , how did u created the Heart Shaped picture filled with High Repetitive text in it .. Please put it on your Next blog ...

  5. Bob Watson says:

    Chandoo, good article. I’ve added a link to it from Connexion – our collection of the most useful and interesting spreadsheet-related articles from the web. See http://www.i-nth.com/resources/connexion

  6. ca.nkv says:

    Hi,

    Just one small question. Where the hell have been I in the past for not discovering this website sooner?

    I've lost a job interview recently where even though I had the subject knowledge, I was not upto their mark in Excel.

    Thank you for all the free tips, guidance and for creating this forum environment.

    [PS: I've just been through the site for the 1st time, and have signed up for the newsletter. You can expect pretty stupid questions from me soon]

  7. William Luke says:

    Hy Chandoo, you always inspire me with to explore something new in excel. This data structure table is only for excel 2007 or compatible to 2010. I recently installed latest excel version 2013 in my System and experience problems regarding operating according to previous one. I'm waiting your article relates to that excel version.

    Thanks

  8. Ankit Bansal says:

    Awesome article Mr. Chandoo and that is a awesome heart shaped pic you created. Great tips as well.

  9. [...] Learn Top 10 Excel Features | Chandoo.org – Learn Microsoft Excel Online. [...]

  10. Arvi says:

    Chandoo is awesome..

  11. Kevin Ko (student major in computer and tech.) says:

    Thanks, i got better, And i always get 90.50 in my grade card but now i get 96.50 i improved because of the tutorials you gave, Thank You Very Much Chandoo Guy.

  12. kiran says:

    Hi chandoo, i am intersted in seeing the video or step by step done procedure of analysing the comments and presenting in the data percentage steps. I think this one would be first step in finding out how generally happens data calculation. Thank you.

    As well i would like to know how to get that black shape art of your face which i see in chandoo. I am interested in making it for me.

  13. l3g4to says:

    Nice to see the features considered by Excel users to be most useful. It might be a good idea to also analyze StackOverflow Excel questions to see what keywords appear most often.

    Here are my top 10 Excel Features (for advanced users):
    http://www.analystcave.com/excel-10-top-excel-features/

  14. Nami says:

    Thanks a ton for this it totally helped with my homework ????

  15. pradip says:

    Very good effort

  16. Barb says:

    Thank you for this. Lots of learning in the links you've provided for this septuagenarian.

  17. Arun says:

    Pls send me new post

  18. Abhay says:

    Dude, your humor ? ?
    Loved your work.

  19. Sanjeev Khakre says:

    Hello Sir,

    I am Sanjeev Khakre and i from Indore City, India , I am your big follower and i have watch your videos and learnt a lots of excel trick or function and many more . thanks so much for all of your excellent support.

    Your excel knowledge is real awesome.

    Thanks
    Sanjeev

  20. Your work is excellent but pls willing to know more details about the features of microsoft excel

  21. philip says:

    Chandoo Would Access be a better alternative than VB?

Leave a Reply