Unpivot and then pivot for clarity (case study)

Share

Facebook
Twitter
LinkedIn

Or more appropriately titled, the one where Power Query solves the problem in less time than it takes you to say Get & Transform Data.

Recently, one of my students Mr. K, sent me a pivot table problem.

Today my boss asked me “how much we paid to staff since the inception of our business with their respective date of joining?” He wanted to know, level wise summary of the last 16 years (on Quarterly / Year wise basis).

The records appended from the database month wise. Have a look to the file and give your ideas.

Mr. K’s data looked like this.

payroll-data-original-pq-casestudy

and his boss wanted a report like this:

payroll-data-report-required-format

What now?

The obvious solution – VLOOKUPs and patience

Even before I could go thru Mr. K’s problem and reply to him, he wrote back to me saying that he found the solution. 

He used what I call as VLOOKUP and patience method. First he unpivoted original data using 233,000+ VLOOKUPs . Then he created a new pivot table from this unpivoted data to answer his boss’s questions.

While this method is fine, it consumes a lot of time and coffee.

A better solution – Power Query and pop corn

We, humans are not evolved to write two hundred thousand VLOOKUPs in afternoons. We are better at building powerful machines, watch them do bad ass work while we chew delicious pop corn.

So why not let the computer solve the problem?

Here is the ridiculously simple four step tutorial to get the same results.

  1. Load the data in to Power Query using From Table feature.
  2. Unpivot all the monthly data columns

    unpivot-monthly-data-pq

  3. Load the data in to Excel as a new table

    payroll-data-after-unpivoting

  4. Pivot it to create the report we need.

    payroll-data-after-pivoting

All this takes less than 15 seconds. Whenever you have new data, simply refresh the connection and everything (PQ, Pivot tables) gets updated.

Download the example workbook

Here is the workbook just in case you need to see everything. Please use Excel 2013 or above to play with this.

More power to you

Power Query is a truly remarkable feature of Excel. It saves you a lot of time and hassle. If you are new to Power Query (also known as Get & Transform data in Excel 2016), check out below tutorials to get started.

How would you solve this?

Prior to Power Query, I would have used VBA (as there is a lot of data) for something like this. For smaller data sets, I would have used VLOOKUPs.

What about you? What method would you use to rearrange data like this? Please share your tips in the comments section.

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

30 Responses to “Great News: Chandoo becomes MVP”

  1. arkangel says:

    Congratulations! It's well deserved. 🙂

  2. Bhars says:

    This is amazing. Hearty congratulations and a rocking new year ahead!!!

  3. Frederick says:

    Congrats! I have learnt alot from your site... and the most important is learning how to achieve the most with the simplest concepts.

  4. Harish Chotai says:

    Thanks for the excel calendar. Is it possible to get a simple big fonted calendar printable on an A4 size paper without any distracive notes or visuals? BTW, I have already signed up for your newsletter. With warm regards and
    Gratefully yours
    50+ year old CHarish.

  5. Pankaj Verm says:

    Hey Chandoo,

    Great to hear that. Congratulations! The best new year gift, I would say. Keep it up, u've been doing extraordinary work for the excel users community.

    Regards,

    Pankaj Verma

  6. Amit says:

    Congrats dude... fantastic news!

  7. Rich says:

    congratulations! your site is great, this is well deserved

    Rich

  8. Arnold says:

    I recently found your site, I visit many. The tips that you provide are in the top 1% of all the sites I visit. Keep on Excelling.

    Arnold
    South Africa

  9. Jorge Camoes says:

    Congratulations, Chandoo! That's a great way to start the year and make the PHD even better.

  10. Jiri Cihar says:

    Congratulations, Chandoo.

    Your site is one of most useful on the net. Happy new year and lot of ideas you will present for us.

  11. Amit Agarwal says:

    Congrats.

    Just read your name in an email from Abhishek. Well deserved.

  12. Jon Peltier says:

    Congratulations, and Happy New Year.

  13. Fchaves says:

    Greetings from Rio de Janeiro my friend! You trully deserve it!

    Nive way to start 2009! Keep up the good work!

    FC

  14. Santosh says:

    That was quite forseeable , so you have now really got your PhD in excel.
    Anyways Chandoo you have made excel a real Fun doo
    I will like you to write some more on INDEX and MATCH function in near future.

  15. Ketan says:

    @Hey Chandoo ! Congrates....

    Ab to treat mangta hai !

  16. Rajiv Thakur says:

    Well deserved Chandoo!!

  17. Cheryl says:

    Congrat's!! Very well deserved 🙂

  18. azmat says:

    i always browsed mr.excel and used to see MVP writtne below names of people who used to solve queries in excel forum there......i just used to admire as to what they have special in them that they are MVP......

    but now i got my answer...............u deserve it man..........

  19. Chandoo says:

    @All: thanks everyone 🙂

  20. JP says:

    Congratulations Chandoo, nice job!

  21. Subbaraman says:

    Chandoo,

    A well deserved recognition and a good start to the New Year. Continue your good work.

    Subbu

  22. Vishal Haria says:

    Many Congratulations.
    You deserve a Ph.D. 🙂

  23. Govar says:

    Congrats dude. Rock on!

  24. [...] charting community in 2007 and has been growing strongly ever since. In year 2009, I have received the MVP award from Microsoft. Just few days back I have become a dad [...]

  25. Respected sir,

    I am impressed!.... Good job done.. Keep it up...

    Sir, How to be a MVP certified person. What level of knowledge is required for it? send me links if possible.

    Please reply...

    Regards,
    Dipak Khalasi.

  26. Jon Peltier says:

    Dipak -

    The first thing you need to cultivate is the ability to search the web effectively. You could start by Googling "Microsoft MVP". 

  27. [...] boy and girl which has been made hectic and incredibly fun ever since to their life.He has been awarded MVP status in 2009 by Microsoft(and renewed in 2010,2011 & 2012).His MVP profile is here.If you want to contact him direct then [...]

  28. Sumit says:

    Congrats Chandoo!!

Leave a Reply