Remove duplicates & sort a list using Pivot Tables

Share

Facebook
Twitter
LinkedIn

Removing duplicate data is like morning coffee for us, data analysts. Our day must start with it.

It is no wonder that I have written extensively about it (here: 1, 2, 3, 4, 5, 6, 7, 8).

But today I want to show you a technique I have been using to dynamically extract and sort all unique items from a last list of values using Pivot Tables & OFFSET formula.

Remove Duplicates & sort list dynamically using Pivot Tables

This is how it goes…,

Step 1: Select your data & Create a pivot table

Just select any cell and insert a pivot table. Very simple right?

Step 2: Drag the field(s) to row label area of pivot

Like this.

Draf the fields to row label area of Pivot Table - Excel

Make sure you have turned off grand totals and sub-totals as we just need the names. And sort the pivot table.

Step 3: Create a named range that refers to the pivot table values

Using OFFSET formula, we can create a named range that refers to pivot table values and grows or shrinks as the pivot is refreshed. Assuming the pivot table row values start in cell F6, write a formula like,

=OFFSET($F$6, 0,0,COUNTA($F:$F)-1,1) and map it to a name like lstProducts.

Dynamic Named Range - from Pivot Table values

The formula gives us all the values in column F, starting F6. The COUNTA($F:$F)-1 ensures that we get only row labels and not the title (in this case Product Names).

Step 4: Use the named range in formulas etc. as you see fit

That is all. Nothing else.

Just make sure that you refresh the pivot table whenever source data changes.

Download example file with this technique

Click here to download an example file and play with it to understand how this works.

How do you deal with duplicate data?

In my work, I come across duplicate data all the time. I have been using pivot table based technique with great success. It is fast, reliable and easy to setup. The only glitch is that you need to refresh the pivot tables whenever source data changes. However, you can automate this by writing a simple macro.

What about you? How do you deal with duplicate data? Share your techniques, tips & ideas using comments.

More tips on using Pivot Tables to Analyze data:

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

14 Responses to “Group Smaller Slices in Pie Charts to Improve Readability”

  1. jerome says:

    I think the virtue of pie charts is precisely that they are difficult to decode. In many contexts, you have to release information but you don't want the relationship between values to jump at your reader. That's when pie charts are most useful.

  2. Martin says:

    Chandoo,

    millions of ants cannot be mistaken.....There should be a reason why everybody continues using Pie charts, despite what gurus like you or Jon and others say.

    one reason could be because we are just used to, so that's what we need to change, the "comfort zone"...

    i absolutely agree, since I've been "converted", I just find out that bar charts are clearer, and nicer to the view...

    Regards,

    Martin

  3. [...] says we can Group Smaller Slices in Pie Charts to Improve Readability. Such a pie has too many labels to fit into a tight space, so you need ro move the labels around [...]

  4. Jon Peltier says:

    Chandoo -
     
    You ask "Can I use an alternative to pie chart?"
     
    I answer in You Say “Pie”, I Say “Bar”.

  5. Karl says:

    This visualization was created because it was easy to print before computers. In this day and age, it should not exist.

  6. DMurphy says:

    I think the 100% Bar Chart is just as useless/unreadable as Pies - we should rename them something like Mama's Strudel Charts - how big a slice would you like, Dear?
    My money's with Jon on this topic.

  7. Mark says:

    The primary function of any pie chart with more than 2 or 3 data points is to obfuscate. But maybe that is the main purpose, as @Jerome suggests...

  8. Chandoo says:

    @Jerome.. Good point. Also sometimes, there is just no relationship at all.

    @Martin... Organized religion is finding it tough to get converts even after 2000+ years of struggle. Jon, Stephen, countless others (and me) are a small army, it would take atleast 5000 more years before pie charts vanish... patience and good to have you here 🙂

    @Jon .. very well done sir, very well done.

    good points every one...

  9. Tim Wilson says:

    I've got to throw my vote into Jon's camp (which is also Stephen Few's camp) -- bars just tend to work better. One observation about when we say "what people are used to." There are two distinct groups here (depending on the situation, a person can fall in either one): the person who *creates* the chart and the person who *consumes* the chart. Granted, the consumers are "used to" pie charts. But, it's not like a bar chart is something they would struggle to understand or that would require explanation (like sparklines and bullet graphs). Chart consumers are "used to" consuming whatever is put in front of them. Chart creators, on the other hand, may be "used to" creating pie charts, but that isn't an excuse for them to continue to do so -- many people are used to driving without a seatbelt, leaving lights on in their house needlessly, and forwarding not-all-that-funny anecdotes via email. That doesn't mean the practice shouldn't be discouraged!

  10. [...] example that Chandoo used recently is counting uses of words. Clearly, there are other meanings of “bar” (take bar mitzvah or bar none, for [...]

  11. Good article. Is it possible to do that with line charts?

  12. Michaela says:

    Hi,

    Is this available in excel 2013?

Leave a Reply