Remove duplicates & sort a list using Pivot Tables

Share

Facebook
Twitter
LinkedIn

Removing duplicate data is like morning coffee for us, data analysts. Our day must start with it.

It is no wonder that I have written extensively about it (here: 1, 2, 3, 4, 5, 6, 7, 8).

But today I want to show you a technique I have been using to dynamically extract and sort all unique items from a last list of values using Pivot Tables & OFFSET formula.

Remove Duplicates & sort list dynamically using Pivot Tables

This is how it goes…,

Step 1: Select your data & Create a pivot table

Just select any cell and insert a pivot table. Very simple right?

Step 2: Drag the field(s) to row label area of pivot

Like this.

Draf the fields to row label area of Pivot Table - Excel

Make sure you have turned off grand totals and sub-totals as we just need the names. And sort the pivot table.

Step 3: Create a named range that refers to the pivot table values

Using OFFSET formula, we can create a named range that refers to pivot table values and grows or shrinks as the pivot is refreshed. Assuming the pivot table row values start in cell F6, write a formula like,

=OFFSET($F$6, 0,0,COUNTA($F:$F)-1,1) and map it to a name like lstProducts.

Dynamic Named Range - from Pivot Table values

The formula gives us all the values in column F, starting F6. The COUNTA($F:$F)-1 ensures that we get only row labels and not the title (in this case Product Names).

Step 4: Use the named range in formulas etc. as you see fit

That is all. Nothing else.

Just make sure that you refresh the pivot table whenever source data changes.

Download example file with this technique

Click here to download an example file and play with it to understand how this works.

How do you deal with duplicate data?

In my work, I come across duplicate data all the time. I have been using pivot table based technique with great success. It is fast, reliable and easy to setup. The only glitch is that you need to refresh the pivot tables whenever source data changes. However, you can automate this by writing a simple macro.

What about you? How do you deal with duplicate data? Share your techniques, tips & ideas using comments.

More tips on using Pivot Tables to Analyze data:

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

17 Responses to “Custom Number Formats – Colors”

  1. Duncan says:

    You are right, Chandoo. I was playing with the colour numbers last week and some of them don't appear different from each other. Others are totally different from yours.

  2. Hui... says:

    @Duncan
    Each version of Excel, post 2003, renders colors slightly differently
    Different language versions may also have different default color palettes

  3. polo says:

    Hello in french
    excel 2010
    colo1 = couleur1 = black
    [couleur1]; [couleur2]; etc..

  4. Andras Ujszaszy says:

    @Hui, thank you very much again for this great post.
    However - under Excel 2007, Hungarian version your solution does not work with color names. I've tried both English and Hungarian names, but drops an error message "not valid formats"

    Do you have any idea how to solve this issue?
    thanks in advance

    • Hui... says:

      @Andras

      Without a Hungarian version of Excel 2003 I don't think I can assist

    • Sarah says:

      Have you tried using the colour numbers? I couldn't get the names to work (despite using an english version of excel). but it did work with the numbers though. I left out the "u" and was easily able to produce burgundy using [color9]

    • Florinel says:

      Here a possible solution: find an English version of Excel, write there the formats using English names, then open the file in the Hungarian version and see the translation.

  5. Nigel says:

    In Excel 2007 I can't get the colour names to work e.g Sea Green but the numbers do e.g color3 - colour3 does not work so I must bow to the country that has stolen my language (ha ha!)

  6. Hey chandoo, nice Tip!
    Wouldn't be easier just apply some conditional formatting for negative numbers and another for positive numbers? Or there's some cases that you can't do that?

  7. Unfortunately the TEXT function doesn't color the cell as number formatting does.

  8. Khalid NGO says:

    Hi Hui,
    Great post Sir, love the new way of formatting with color numbers.
    I am using 2007, and it leads me to the last color number 56.

    Thanks Hui.

  9. […] explains how to set up custom number formats with a wide array of […]

  10. Colin says:

    Thanks Hui - works a treat!

  11. John Smith says:

    Thank you, very helpful.
    Trying to figure out if it is possible to apply color only to a part of the cell?

    E.g. I have a value formatted as Accounting with a currency symbol.
    Those I find somewhat distracting though necessary. If I could make them less obtrusive by coloring them gray while the number would stay black, that would be great. Tried tinkering with the format string, but didn't get the desired result. Single color for complete cell value works, but coloring just part of it could not be achieved. Maybe somebody managed that?

  12. Shaun says:

    Exactly what I was looking for - thank you!

  13. colour in the Australian doesn't work - we have to go American and no problem.
    I always thought is was 56 colours notice you have 57. Cool.

    thanks
    Analir Pisani
    Customised Microsoft Office Training Specialist
    Sydney - Australia
    http://www.azsolutions.com.au

  14. Me Myself says:

    Thank You!

Leave a Reply