Power Query (Get & Transform data in Excel 2016) is a must have tool, if you wrangle with data every day. Here is a quick introduction, in case you are new.
Let’s learn how to use Power Query to unpivot data.
Essentially, we are trying to go from left to right in this picture.
Doing something like this thru either formulas or VBA can be very complex. But Power Query can get you unpivoted data in just a few clicks. Sounds interesting? Read on.
Tutorial: Unpivot data using Power Query
Step 1: Set up your pivoted data as a table
If you want Power Query to work with data in Excel, it must be in table form. So select any cell in the pivoted data and press CTRL+T to turn it in to a table.
At this stage, we get this:
Step 2: Load table data in to Power Query
While keeping the selection inside pivot data, go to Power Query ribbon (or Get & Transform area of Excel 2016 data ribbon) and click on “from Table” button.
This will take your table data and load it in to a new query in Power Query. It looks like this:
Step 3: Get rid of grand totals
When unpivoting data, we don’t need the grand totals. To remove them,
- Select the grand total column
- Click on “Remove Columns” button in query editor (Power Query window)
- Click on “Remove Rows” button, select remove bottom rows option.
- Enter the number of rows as 1
At this stage, grand total column & row are gone. We end up with this:
Step 4: Fill down the missing region names
If your pivot table has null / blank values in the first column, you can fill them with values from above cells using the Fill option of query editor. Select the Region column and click on the Fill button from transform ribbon. See this demo:
Step 5: Remove sub-total rows by filtering them away
Click on the filter button next to region and filter away all the sub-total columns too. We don’t need them for unpivoting.
Step 6: Unpivot the data
Now that our data is in correct shape, let’s unpivot.
Select the last 3 columns and click on Unpivot columns button in Transform ribbon.
And we get the unpivoted data.
You can load this data to Excel or to your data model for further processing.
Download example Power Query workbook
Please click here to download the example workbook for this tutorial. To examine the query settings and power query steps,
- Open the workbook
- Go to Power Query ribbon (or Data ribbon in Excel 2016) and click on Workbook Queries Show Pane option.
- Right click on “Unpivot Data” query and choose edit
- This opens the query editor. You can examine the steps in the query steps pane to right.
Learn more about Power Query / Get & Transform data:
Power Query (or less intimidating Get & Transform data in Excel 2016) is an impressive technology to help you deal with common data problems easily. If you are an analyst who relies on Excel, learning Power Query is going to make you super productive. Check out below tutorials to get started with this amazing feature.
- Introduction to Power Query – podcast
- Importing web data using Power Query
- Recommended Power Query training from Ken & Miguel
How do you unpivot your data?
I used to write VBA programs to unpivot my data. But now that I have Power Query, I use it anytime I need unpivoting.
What about you? How do you unpivot your data? Please share your thoughts and tips in the comments section.
24 Responses
I’d suggest simply using the subtotal function and filtering the data using the Win/Loss column. You get the same results and the formula is more comprehensible.
@John
That is one option.
There are times however when you want to see the whole data table or a filtered subset and still want to produce summary reports against an unfiltered field.
Is there a particular reason why you are using a comma and the unary (–) operator for the second array in the SUMPRODUCT formula? It seems to work the same if you were to string the arrays together using the asterisk (*). The advantage is that SUMPRODUCT treats the entire string of arrays as a single array.
@Mathew
Your correct, There is no difference.
I thought it may have been easier to explain this method.
Is there a way to do this on a large set of data? As in ~100,000 rows? When I try I get an error because the formula becomes too long. It says the max length of a formula is 8,192 characters. Excel 2010.
How do I incorporate a specific text within a cell for the second array. For instance, – -(C7:C13=”Apple”)
when I chose a specific text the formula does not work.
@RB
I am not sure what is the issue as if I use the sample data in the post the following work fine
Count:
=SUMPRODUCT(SUBTOTAL(3,OFFSET(C7:C13,ROW(C7:C13)-MIN(ROW(C7:C13)),,1)), –(C7:C13=”L”))
Sum:
=SUMPRODUCT(SUBTOTAL(3,OFFSET(C7:C13,ROW(C7:C13)-MIN(ROW(C7:C13)),,1)),(C7:C13=”L”)*(D7:D13))
You may want to check that there are no leading or trailing spaces in your list of Apples
I should have given a better explanation. Heres my situation. I have a column with cells filled with names like Column 1, Column 2, Pier 1, Pier 2, etc. If the cell just contained Pier and searched for that it works. But because it has other characters in the cell its not recognizing the pier. So how can I extract specific characters of a string of text in this formula?
Hopefully this was a better explanation
Hello-
This formula works pretty well for me except that it slow down excel and prevents some of my macros from working. I was wondering if there was a way to program this in VBA so that excel isn’t always trying to recalculate it. I would like to use a push of a button to get it to run then paste in a cell.
Thanks!
I am trying to sum filtered data in a column, but would want to ignore the negative values in the column. How to go about doing this?
@Akshay
Why not just add a filter to that column to only show the values greater than zero?
The negative values are required for reporting purposes, but their effect on the total is distorting the required output. Please advise.
@Akshay
I’d suggest making a post in the Chandoo.org Forums
http://forum.chandoo.org/
Attach a sample file to simplify the task
I have this working for counting and summing, however, I have a list and for the second array, I need a criteria. That is, I’m looking for b13:b200=”01.??.??” or =left((a1,2) or something like that. These types of criteria matches do not appear to work as I get a blank as a result.
Thanks!
@Bob
As your formula b13:b200=”01.??.??” looks like you are trying to check the first day of the month of the range
What about trying Day(B13:B200)=1
Hai Experts,
i understood this formula well and working fine in MS Excel 2013
but when the same am trying to place in google Spreadsheet it shows error as
“SUMPRODUCT has mismatched range sizes. Expected row count: 1. column count: 1. Actual row count: 2014, column count: 1.” and as a result #VALUE! Appears in cell.
Can anyone please help me how would i get it done in Google Spread sheet
or is there any other formula as a substitute for this.
Thank you very much.
thanks for providing this.. but why does excel keeps on prompting Circular referencing in cell D3?
@Vivek
I don’t know
I just downloaded the file and it is working fine and not showing that error
Goto the Formulas, Calculation Options Tab and check that Calculation is set to Automatic
What version of Excel and Windows are you using ?
I know that this forum is for MS Excel, but I am trying to help someone who is working in Google Sheets. The below formula works in Excel but Google Sheets returns:
“SUMPRODUCT has mismatched range sizes. Expected row count: 1. column count: 1. Actual row count: 39000, column count: 1.” and as a result #VALUE! Appears in cell.
This is the same problem asked by Srichirin above. Does anyone know if there is a formula for Google Sheets that will replicate what MS Excel does?
=SUMPRODUCT(SUBTOTAL(3,OFFSET($C$6:$C$39500,ROW($C$6:$C$39500)-MIN(ROW($C$6:$C$39500)),,1)),- -($C$6:$C$39500=H1),($D$6:$D$39500))
Trying to find a SUMPRODUCT formula that counts the word Closed by date for the last 7 days in a filtered list.
=COUNTIF(M:M,”>”&TODAY()-7) works ok for unfiltered count Column M contains Closure dates (blank if open) and Column L is Status Open or Closed
@ Terry
Please ask the question at the Chandoo.org Forums
https://chandoo.org/forum/
Please attach a sample file to ensure a quicker more accurate answer
I used this formula and worked like a charm! But, now I’ve been requested to use it but adding not one but two criteria in the same formula. For instance the sum I was doing added negative and positive numbers. I’ve been asked to use the exact same formula but adding that only positive numbers were considered… any idea on how to do this?
How exactly do you do sum filtered cells when two criteria are need not just one?
Thank you so much brother literally I have been struggling since morning to get the sum of the filtered category, however, after reading your blog attentively i got my solution, so thanks a lot once again.