Recently, we discussed about the case of unwieldy data and how we lookup what we want using formulas like SUMIFS. Today, let us learn few more ways to solve the same problem.
First, a re-cap of the problem:
Here is a data-set:
The problem – build a lookup formula
And the problem. Oh, simple. Write a lookup formula to find how many customer walk-ins we have on any given day.
In the previous article, we discussed how to use SUMIFS to solve this problem. There were several amazing & awesome solutions shared by our readers in the comments section too.
Suitable structure spawns simple solutions
Poorly structured is the 2nd biggest problem of analysts. The first one is not enough coffee. That is why there is a dictum in the data analytics world.
Structure is everything
So, we can easily solve our lookup problem, if our data were to magically re-arranged in 2 column fashion – Data & Value.
This transformation can be done in 2 ways:
Option #1: Transforming Data – Using Formulas
We can use data fetching formulas like OFFSET or INDEX to re-arrange data in 2 columns.
Assuming,
- Our 2D data is in a named range data,
- There are running numbers starting with 0 in the cell J5
We can use below formula to fetch first column:
=IFERROR(INDEX(data,2*(INT(J5/7))+1,MOD(J5,7)+1),"")
for the second column, below formula works:
=IFERROR(INDEX(data,2*(INT(J5/7)+1),MOD(J5,7)+1),"")
How does this formula work?
I will explain the formula for first column. Deciphering 2nd column formula is your homework.
Here is the formula again: =IFERROR(INDEX(data,2*(INT(J5/7))+1,MOD(J5,7)+1),"")
Before understanding the formula, let’s take a minute to examine the structure of our raw data.
- Odd rows contain dates
- Even rows contain values
- There are 7 columns in total
- So to get the first date, we need to go to row 1 (first odd number), column 1
- To get the first value, we need to go to row 2 (first even number), column 1
- But to get 8th date, we need to go to row 3(2nd odd number), column 1
- So on
Let’s go from inside out.
2*(INT(J5/7))+1portion: This gives row number (ie odd number). J5 refers to running number and its value is 0. So we get 2*(INT(0/7))+1 = 1- This will be 3 when J5 becomes J12 (ie 8th date)
MOD(J5,7)+1portion: This gives column number. It will result in values 1 thru 7 in a cyclical fashion. Thanks to MOD.INDEX(data, ..., ...)portion: Now that we have both row & column numbers, INDEX formula kicks in and gets the corresponding date.IFERROR(INDEX(...),"")portion: This is to help in case we ran out of all dates & values in our INDEX formula. Read about IFERROR here.
Once you have the formulas for first date & value, simply drag them to get rest of the values.
Option #2: Transforming data – Using VBA
VBA Macros are perfect for scenarios like this. Usually transformation is something you need to do every-time you import data from external systems. So simply write a macro that can do this automatically.
Assuming our data is in the range data and the first cell of our extraction range is startHere, you can use below macro:
Sub rearrangeData()
'takes the values in DATA named range and rearranges them
'from the named cell startHere
Dim cell As Range, i As Long, j As Long, evenRow As Boolean, firstRow As Long
i = 0
j = 0
firstRow = Range("data").Cells(1).Row
For Each cell In Range("data")
evenRow = (cell.Row - firstRow + 1) Mod 2 = 0
If evenRow Then
Range("startHere").Offset(j, 1).Value = cell.Value
j = j + 1
Else
Range("startHere").Offset(i, 0).Value = cell.Value
i = i + 1
End If
Next cell
End Sub
How does this macro work?
Before jumping in to the lines of code and demystifying the logic, Let’s understand what we need to do:
- For each cell of data,
- If it is in odd row, put the cell data in Date column at end
- Else, put the cell data in Value column at end
- Repeat
This is what our code is trying to do.
Let’s examine the For Each loop, as this is the most critical part of our macro.
- For each cell in the range data
- We check if we are in evenRow using simple arithmetic on row numbers
- If we are in evenRow then
- We put the cell value in row j (number of values so far), column 2
- We increment j
- Else
- We put the cell value in row i (number of dates so far), column 1
- We increment i
- Close the IF condition
- We check for next cell in the data range
Advantages of Transformation over SUMIFS approach
Both options for transforming data have few advantages:
- They work with any type of data (unlike SUMIFS, which works only for numeric lookups and has few other issues)
- Once data is restructured, you can do other types of analysis like creating pivot tables, adding extra calculated columns etc. easily.
Download Example Workbook
Click here to download example workbook that shows original SUMIFS solution, both options for transforming data & few other formulas. Play with it to learn more. Check out the code by pressing ALT+F11.
How would you transform data?
My favorite techniques for transforming data are – VBA, formulas, Power Query, pivot tables & SQL. Depending on the situation, time availability, where my data is, I choose one of these options to scrub my data.
What about you? How do you clean up / scrub data like this? Please share you thoughts & tips with us in comments.
Instructions for washing your dirty data
If your work involves scrubbing dirty data, check out below tutorials too:
- Extract numbers from text using VBA and formulas
- Filling blank cells with above values in tables
- Cleaning up in-correctly formatted dates
- Fixing in-correctly formatted phone numbers
- Reverse a list using INDEX formula
- Transpose a table using formulas
37 Responses to “Pie of a Pie of a Pie chart [Good or Bad?]”
If I could have the same quality of graphics and illustration in Office Apps, I would certainly use it.
If I could have the same quality of graphics in Office Apps (Excel, PPT) I would certainly use it.
Chandoo,
First, let me say I love your blog. I like this post, and I think that technically (in terms of readability of data) your argument is correct. The bar of bars, and the table, are much better for readability and accuracy, and as you say would be much easier to produce.
But these points ignore the context of the chart. If the chart was part of a scientific paper, your solution would be a valid one. The context in this case is an illustrated atlas of wildlife. A companion graphic to go with written text. The importance of aesthetic goes up over readability and accuracy. Much of the data and points (I assume) will be covered in the text.
There's always a pure technical tufte-esque argument. But I sometimes think it ignores the value of aesthetics. (Which I admit are quite subjective)
Great post though. Thanks.
The Treemap makes the scope of the data much clearer! The 3D pie chart depiction is deceptive.
This reminds me of the videos ive seen on the internet where it compares the relative sizes of the earth with the larger planets, then the sun, then other stars in the galaxy. Eventually there is an image showing the largest star in the sky with a little pixel representing the sun.
My point is if you varied the size of the charts it would help convey the message. The first chart (salt vs fresh) would be the biggest and the rest would be arranged in descending order. I feel this would be more accurate.
It may be helpful to consider the advice of Steven Few and Edward Tufte regarding pie charts in general. To summarize, they are seldom the most useful way to present data. Here's Few's thoughtful piece on the subject.
http://www.perceptualedge.com/articles/08-21-07.pdf
Try putting the percentages on the bar charts instead of actual amounts. Lakewater would be .013 % instead of 52.
That is very good pie chart example.
Please send example file if it is possible.
It will work , even though colors may be confusing , it can be labeled well . Also it can be called as the drilled chart , as it drills in information further , like the first chart may show business in a region , second may drill into a particular region , thrid may further drill into wat products are there in that region . It works well for me , i would more vote for the 2 nd option .
Overall all this site is awesome ,
p.s : just like me
The risk with pie of a pie of a pie chart is that Jon may have a seizure by looking at it. Also, it isn't easy to read. 😉
I dunno. The only thing worse than a pie chart is a cascading series of pie charts. I don't even think they really lend themselves to this sort of thing. It just becomes a big hide-the-ball game with your viewer.
Those goofy connectors between the pies are pure chart junk. I can't really tell if the second chart has 2 series or 3 - because the connector is a different color than the 2 labeled slices. Despite that, even whereas the drill down kind of works, still the individual components suffer from the same old weaknesses that 3d pie charts have.
Use a large bar chart as your "cover story", and fill in the sub points with smaller bar charts - or even go grab the Fabrice SFE project for extra butter. Use page orientation, color, and some text styles to guide your audience through the drill downs.
FWIW, if you check out the guy's site, you can find several other truly mortifying charts:
http://www.andrewdavies.com.au/index.html
The methane emissions one is particularly heinous. Although, I'm kind of debating what I think about the 'Glacier Changes" chart. I'd kind of like to see the data on that to see how it would look in a more traditional horizon chart.
Thank you, that was scary. I don't understand the "Glacier changes" Chart at all...
Its a very nice way to represent the data, especially when we have sets and sub-sets within the data.
I like these!
Except for the fact that they aren't dynamic and hence must be setup manually each time
It would also be nice if they could be interrogated as in select a different segment and the new data falls out automagically, but then none of the standard Excel charts do that either.
I'd like it better if the bars were stacked. How about this idea (I hope I can convey it in words):
First bar is vertical and stacked.
Second bar is horizontal, stacked horizontally and the same proportion had it been on the first bar.
Third bar is vertical, stacked vertically and the same proportion had it been on the second bar.
Then it would really look like you are zooming on the chart, like the Powers of Ten video, or maybe like the golden ration spiral.
These looks shunting but setting up for each step makes kicks them out. However if these can be arranged automatically by native excel or by VBA, these will be the part of my "Archery"
I agree with Chandoo's Suggestion about the Bar Graph which represents data in a very appropriate manner. Even I prefer doing the same. I seldom use Pie Chart unless required.
That's a real nice example of a missleading infographic. But to be honest, I think chandoos suggestion is not much better!
Why are pie charts bad? I think because they don't show the real size-relations. The biggest pie in that example ist 300k big. The 2nd one has only the size of 10k, about 3% of the first one. Niether the pies nor the bars show the real sizes. I jnow, it's hard to show the sizes because the values of the second and the third pie are so small. But that's what visualization are about - showing relations to allow the reader to see the real sizes!
So how to show the real figures?
First possibility is o use a 1:1 scaling. Well then, you need a very big screen to show also after a 90° rotation, wihich I would prefer because it's a structural comparison and not a timeline. Maybe that solution is not the perfect way.
The other chance you have is to zoom in but to really show that you zoom in! http://www.pro-chart.de/images/Water_Fall.png maybe gives you a first impression what i mean. (i was a quick try, done in 10 minutes)
The next way is, maybe to fold the bars like in the financial report 2011 of the Post of Switzerland page 22. That chart is based on an excel chart. Maybe can explain you how to do it 😉
Financial Statement: http://www.post.ch/en/post-startseite/post-berichterstattung/post-berichterstattung-service/post-berichterstattung-downloads/post-gb-2011-finanzbericht.pdf
page 22: http://www.pro-chart.de/images/FS_Schweizer_Post.png
A way that is not so very common is to divide the bars in a lot of single datapoints. So maybe the 390k bar then consists of about 5,000 single datapoint. That's not possible - it is! Have a look:
http://www.pro-chart.de/images/Dotted_WF.png
It's pure excel!
Now one single point ist 0,2% of the whole (in the example above). Add more datapoints and you can visulize the very big and the very small numbers!
Wish you a lot of fun - visualizing with excel can be very powerful!
Joerg
...if you would like to know how these charts work, just send an email to J.Decker@pro-chart.de
Hey Joerg,
I don't dig so much the dotted waterfall thing. But this is kind of awesome:
http://www.pro-chart.de/images/FS_Schweizer_Post.png
Can you help me on the bar of bar graph? Would it be possible to create that from pivot table? Can you show me how to create the bar of bar graph?
do nothing but say "Awesome!"
You are a Rock star.....This seemed an answer as if someone was reading my mind and just had the solution to my questions on what I exactly was looking for .....What a Fab !!
can u explian me step by step
Can anyone please explain how to make this chart please.
Do you mean the pie of a pie chart or the folded bar chart?
Joery PIE OF PIE Chart please
Can someone please explain how to make PIE OF PIE Chart.
@Mandeep
The last line of the post is:
PS: If you want to know to create this pie of pie of pie chart in excel, see here.
Due to forum migration, link is now:
http://chandoo.org/forum/threads/multiple-pie-chart.7343/
Hi... i love these charts.... can any one show me how to draw these charts in excel 2010
@Vamshi
The very last line of the post refers you to:
PS: If you want to know to create this pie of pie of pie chart in excel, see here. http://chandoo.org/forums/topic/multiple-pie-cahrt
Where is the attachment....it used to be there...i have seen this before but now i am not able to find...
See this:
http://img.chandoo.org/playground/WaterDistribution-chandoo.xlsx
And this:
http://chandoo.org/forum/threads/how-do-you-create-this-chart.9743/
Normally I don't learn post on blogs, however I would like to
say that this write-up very compelled me to try and do so!
Your writing style has been amazed me. Thank you,
quite great article.
This is very impressive, I would like to learn how to build this for myself. I have tried for some time now, is there a step by step process on how to create these waterfall pie of pie charts?
I am novice to excel and use it very seldom. But your blog contains to the point information one needs to get going.
I was searching for a trick to do a Pie chart drill down - for example the first pie chart shows how the prices are distributed between perishable and non-perishable items.
Now if we want to know how the perishable items are distributed - one can click the segment and it will draw another pie chart with distribution of all different perishable items (milk,meat,fruit,veg etc)
So do you have any such trick?
Regards,
electrojit
I like the look of your pie of pie of pie chart, although I understand that the relative size of each pie does not represent the actual percentages.