Recently, we discussed about the case of unwieldy data and how we lookup what we want using formulas like SUMIFS. Today, let us learn few more ways to solve the same problem.
First, a re-cap of the problem:
Here is a data-set:
The problem – build a lookup formula
And the problem. Oh, simple. Write a lookup formula to find how many customer walk-ins we have on any given day.
In the previous article, we discussed how to use SUMIFS to solve this problem. There were several amazing & awesome solutions shared by our readers in the comments section too.
Suitable structure spawns simple solutions
Poorly structured is the 2nd biggest problem of analysts. The first one is not enough coffee. That is why there is a dictum in the data analytics world.
Structure is everything
So, we can easily solve our lookup problem, if our data were to magically re-arranged in 2 column fashion – Data & Value.
This transformation can be done in 2 ways:
Option #1: Transforming Data – Using Formulas
We can use data fetching formulas like OFFSET or INDEX to re-arrange data in 2 columns.
Assuming,
- Our 2D data is in a named range data,
- There are running numbers starting with 0 in the cell J5
We can use below formula to fetch first column:
=IFERROR(INDEX(data,2*(INT(J5/7))+1,MOD(J5,7)+1),"")
for the second column, below formula works:
=IFERROR(INDEX(data,2*(INT(J5/7)+1),MOD(J5,7)+1),"")
How does this formula work?
I will explain the formula for first column. Deciphering 2nd column formula is your homework.
Here is the formula again: =IFERROR(INDEX(data,2*(INT(J5/7))+1,MOD(J5,7)+1),"")
Before understanding the formula, let’s take a minute to examine the structure of our raw data.
- Odd rows contain dates
- Even rows contain values
- There are 7 columns in total
- So to get the first date, we need to go to row 1 (first odd number), column 1
- To get the first value, we need to go to row 2 (first even number), column 1
- But to get 8th date, we need to go to row 3(2nd odd number), column 1
- So on
Let’s go from inside out.
2*(INT(J5/7))+1portion: This gives row number (ie odd number). J5 refers to running number and its value is 0. So we get 2*(INT(0/7))+1 = 1- This will be 3 when J5 becomes J12 (ie 8th date)
MOD(J5,7)+1portion: This gives column number. It will result in values 1 thru 7 in a cyclical fashion. Thanks to MOD.INDEX(data, ..., ...)portion: Now that we have both row & column numbers, INDEX formula kicks in and gets the corresponding date.IFERROR(INDEX(...),"")portion: This is to help in case we ran out of all dates & values in our INDEX formula. Read about IFERROR here.
Once you have the formulas for first date & value, simply drag them to get rest of the values.
Option #2: Transforming data – Using VBA
VBA Macros are perfect for scenarios like this. Usually transformation is something you need to do every-time you import data from external systems. So simply write a macro that can do this automatically.
Assuming our data is in the range data and the first cell of our extraction range is startHere, you can use below macro:
Sub rearrangeData()
'takes the values in DATA named range and rearranges them
'from the named cell startHere
Dim cell As Range, i As Long, j As Long, evenRow As Boolean, firstRow As Long
i = 0
j = 0
firstRow = Range("data").Cells(1).Row
For Each cell In Range("data")
evenRow = (cell.Row - firstRow + 1) Mod 2 = 0
If evenRow Then
Range("startHere").Offset(j, 1).Value = cell.Value
j = j + 1
Else
Range("startHere").Offset(i, 0).Value = cell.Value
i = i + 1
End If
Next cell
End Sub
How does this macro work?
Before jumping in to the lines of code and demystifying the logic, Let’s understand what we need to do:
- For each cell of data,
- If it is in odd row, put the cell data in Date column at end
- Else, put the cell data in Value column at end
- Repeat
This is what our code is trying to do.
Let’s examine the For Each loop, as this is the most critical part of our macro.
- For each cell in the range data
- We check if we are in evenRow using simple arithmetic on row numbers
- If we are in evenRow then
- We put the cell value in row j (number of values so far), column 2
- We increment j
- Else
- We put the cell value in row i (number of dates so far), column 1
- We increment i
- Close the IF condition
- We check for next cell in the data range
Advantages of Transformation over SUMIFS approach
Both options for transforming data have few advantages:
- They work with any type of data (unlike SUMIFS, which works only for numeric lookups and has few other issues)
- Once data is restructured, you can do other types of analysis like creating pivot tables, adding extra calculated columns etc. easily.
Download Example Workbook
Click here to download example workbook that shows original SUMIFS solution, both options for transforming data & few other formulas. Play with it to learn more. Check out the code by pressing ALT+F11.
How would you transform data?
My favorite techniques for transforming data are – VBA, formulas, Power Query, pivot tables & SQL. Depending on the situation, time availability, where my data is, I choose one of these options to scrub my data.
What about you? How do you clean up / scrub data like this? Please share you thoughts & tips with us in comments.
Instructions for washing your dirty data
If your work involves scrubbing dirty data, check out below tutorials too:
- Extract numbers from text using VBA and formulas
- Filling blank cells with above values in tables
- Cleaning up in-correctly formatted dates
- Fixing in-correctly formatted phone numbers
- Reverse a list using INDEX formula
- Transpose a table using formulas
54 Responses
Hi Chandoo,
This is awesome *****
Found 6, just one remaining, and I think it should be in sheet2, as I found 1 in each sheet but didn’t found anything in sheet2 (till yet, I am keep looking).
Very cleaver and amazing work, enjoyed a lot…
Thanks Chandoo for this beautiful work.
Wish you have great time at Hyderabad.
Regards,
Khalid
go to AB201 on Sheet2, you will see Panda there !!!
Press F2 in Cell A1 and then read the actual text !!
In Sheet 2 go to Cell AB201. You will find one.
There is one on first sheet, if you press F5 (goto), the word PANDA can be seen there.
Oh I found the last one, (custom format hmm)
Truly Amazing and the beauty of this forum.
You are an Artist Chandoo.
Hi Chandoo,
Wow, you really have magical skills. I am in office and this sheet ate up an hour of my time….didn’t expect that.
I could find 5 of the 7 pandas. Didn’t know one could hide so much data in innocent looking excel sheets.
Thanks!
-Ranjith
yeah! found all 7 panda, time to go to china.
This was very fun and challenging, thanks for posting! I found all of them (well, Sheet1 was tricky, it seems you’re supposed to find the cell and type it in yourself?). Wasn’t sure if it was cool to post the answers here or not, though. Guess I’ll post SPOILER ALERTS so you can skip the rest of the message if you don’t want to see what I came up with.
SPOILER! SPOILER! SPOILER!
My answers appear below.
Sheet1: type PANDA in cell PAN3489
Sheet2: cell AB201
Sheet3: cell J8 (Picture1)
Sheet4: cell H9
Sheet5: expand Chart1
Sheet6: formula = “=MID(ADDRESS(9,2^3*23*59,4),1,3)&BIN2HEX(11011010)”
Sheet7: named range (A1:I18)
Wookie – I would love to get a walkthrough of HOW you figured out sheet 1 and a bit of a formula walkthrough for Sheet 6.
Basically, I don’t know how I could have found that particular cell input message on Sheet 1.
And I have no clue about the BIN2HEX part of the formula…before your hint I was able to get the output to read AN9DA. The change to MID and the addition of that ‘,1’ changed it to PANDA…
Hi Rachel,
To get to the cell in sheet 1 you can press: ctrl G. Then special and then data validation: all. This is also the way to find panda in sheet 7 😉
I agree, this was a fun way to test your ability to navigate through the functionality of Excel! And since you already posted the SPOILER ALERT warning, I should be safe posting a reply to your comment with some solutions of my own… 🙂
I found all the same solutions you did with a few minor changes:
Sheet1: If you notice, cell PAN3489 has Custom formatting. You don’t have to type “PANDA”, just the number 1.
Sheet6: The MID function works as you described, but you can also simply change the RIGHT function to the LEFT function without having to add in the start and end positions for MID.
Sheet7: Yes, the range name for these cells is called PANDA, but you don’t see the actual word in the sheet unless you change the Zoom setting to 39% or less (hence the clue “Z” 39%).
Thanks again for a great post, Chandoo!!
I must admit sheet 7 defeated me, but I have some corrections
Sheet 1 – you type =LEFT(ADDRESS(ROW(),COLUMN(),2),3)&DEC2HEX(ROW())
in PAN3489 to get “PANDA1”. As it is the first panda. I think panda1 is appropriate, but maybe
=LEFT(ADDRESS(ROW(),COLUMN(),2),3)&LEFT(DEC2HEX(ROW()),2)
is better, because it leaves you with “PANDA”
Sheet 6 – I corrected to
=LEFT(ADDRESS(9,2^3*23*59,4),3)&BIN2HEX(11011010)
Picky I know, but who uses mid when a right or a left will do?
I know; that was weird. I did try using a LEFT formula, but I kept getting the $ prefix from the cell address. So I tried a couple of variations using MID and it gave me the result I needed. This is actually the first time I’ve ever tried using a MID formula starting at the first character, but I wasn’t trying to spend a lot of time on it, so I went with what worked.
Sheet1: Type 1 in PAN3489
Sheet6: =LEFT(ADDRESS(9,2^3*23*59,4),3)&BIN2HEX(11011010)
Slight change…
For sheet 1 goto PAN3489 and type in 1. The word PANDA appears.
Love it!
Sheet 6 was my favorite. How many people still know what binary, hex and octal are? :o)
—–Spoilers———
Alternate Solutions
1) Type “1” (not the quotes) in PAN3489 and Excel will turn “1” into “PANDA”
6) The formula Wookie lists also works with LEFT in place of MID
Lot of fun. Solve time ~20 mins.
@ Rob
How this 1 turns to PANDA .. means How this is done by excel any formula or something in VBA
Also how to reach cell PAN3489 .. there are no clues given on sheet 1
You reach PAN3489 by pressing Ctrl + End to bring you to the last used cell in Sheet 1
@ Navdeep I found PAN3489 by going to “Formulas” and then “Name Manager” and saw there was a field called “Clue1” listed in the Name Manger that references 3489. Finding PAN as the column index was just a bit of a lucky guess through trial and error. Then a note in cell PAN3489 when you navigate there says to try “typing something.” I tried scrolling through the Format Cells menu to see if the text typed in the cell needed to be formatted a certain way, and noticed that “1= Panda” was listed in the custom text menu and tried it. A bit brute force, but I think the desired text entry.
Clever!
The Data Validation one took me a bit. Had to resort to brute force.
Thanks for the fun!
Awesome! Found 7 pandas in 20 minutes)))
Sheets 1 and 6 were the best!
Thanks!
Sheet 1: The answer is not type in Panda. Type 1. There’s a special formatting that replaces 1 with Panda.
Sheet 6: Just replace right with left, don’t worry about changing the numbers.
Sheet 7: I found the named range, but don’t know what the Z 39% means. Thoughts?
when you changed the zoom level to 39% or below, you will see the name of namedrange (if any)
WOW! I’ve just found the secret eighth PANDA!
Truly awesome!!!
Am I the first one who figured that out, guys?
Btw, thanks for the puzzle!
Found them all – very inventive. Had to think outside the “box”. Great fun!
It was truly a artists work
chandoo you are grate
all sheets are deigned different from each other
@Wookiee: you have a good for others by posting the answers, Thank you too
it is fun and great invent
Guys I Got 8 PANDA in the workbook… 🙂
[Look Chandoo has against played great trick by reserving one more ester egg, but we are also fan of none other than Chandoo, who can get hold of hidden 8th (untold) ester egg]
Here is the full list:
1) Sheet1: Type 1 in Cell PAN3489
2) Sheet2: Goto Cell AB201
3) Sheet3: Check the picture located above cell J8
4) Sheet4: Goto Cell H8
5) Sheet5: Cells, viz., A4, A10, A16, A21, A29 have all alphabets of PANDA
6) Sheet5: Resize the chart to see PANDA
7) Sheet6: Correct the formula as LEFT(ADDRESS(9,2^3*23*59,4),3)&BIN2HEX(11011010)
8) Sheet7: Range A1:I18 is named as PANDA
1) Sheet1: Type 1 in Cell PAN3489
2) Sheet2: Goto Cell AB201
3) Sheet3: Check the picture in the cell J8
4) Sheet4: Goto Cell H9
5) Sheet5: Resize the chart to see PANDA
6) Sheet6: Correct the formula as LEFT(ADDRESS(9,2^3*23*59,4),3)&BIN2HEX(11011010)
7) Sheet7: Range A1:I18 is named as PANDA
Actually, for sheet7, if you set the zoom to 39% or less, you will see the word PANDA. Yet another PANDA! 🙂
Hi,
i want to know how to manage bill wise manage vendor invoice and payment in excel please suggest.
Thanks,
Ram
Hi Chandoo!
You rock with these amazing skills!
Sheet 1: ??
Sheet 2: ??
Sheet 3: Cell J8
Sheet 4: Cell H9
Sheet 5: A4, A10, A16, A21, A29
Sheet 6: B2
Sheet 7: ???
Sheet1 F5
Sheet2 AB201
Sheet3 Picture1
Sheet4 H9
Sheet5 Chart
Sheet7 Zoom to 30%
I love this time of year and look forward to Chandoo’s egg hunts. Whilst I got all the pandas, I do not understand how sheet 7 works; Where is the source data and why does it only work when zoomed out to 39% or more?
@Leon-K
When you change the zoom level to be less than 40% Excel shows the Ranges which have Names applied to them
Ha ha, that’s fantastic. Thanks Hui. @Chandoo, thanks for yet another method to decrypt worksheets in order to re-build or explain them better to clients.
These were fantastic and kept me intrigued until I could finish them. (Had to look here for help with Sheet1!) Definitely learning a lot about some new formulas. Awesome, Chandoo!
Ok, just saw the notes on the Zoom 39% on Sheet 7. Can someone explain what’s happening here and why PANDA shows up at that level?
@Bryan
When you change the zoom level to be less than 40% Excel shows the Ranges which have Names applied to them
Wow, great exercise.
Tried and solved 5 out of seven and other two solved incorrectly (1 & 6).
Thanks 🙂
Hi Chandoo,
Gr8 …had fun in searching it. I got 5 out of 7.
You are brilliant.
Found all except in sheet6 as not able to understand formula.
thanks
Raja Aurongzeb
Hi,
I am not able to find 1st Panda, which is on Sheet1. Rest all I have found.
Wonderful Chandooji… you are brilliant.
Wow.. Awesome set of puzzles Chandoo!!
Am now trying to figure out how sheet 7 was prepared.. 39% Zoom setting logic.. Can someone help me with a hint?
Thanks!
Looks like this is an XL feature.. Zooming out the worksheets below 40% level, by default displays all named ranges (more than 2 cells)! Had not come across this till date..
Great works! Was having FUN in finding the pandas. Thanks.
btw, I used one basic function (Find, CTRL+F) to find 2 pandas. Simply Find “Panda” within “Workbook”… To my surprise, seems no one mentioned that in the process.
On other other hand, Selection and Visibility Pane is a handy tool to see if there is “extra” shapes for locating pandas hidden in chart/picture.
Had fun doing this, Found 5 and the rest I saw clues on here 🙂
I really enjoyed when finding the pandas.And also I am so surprised.Very Nice thought and Excellent.
This was fun! Thanks!
Nice and fun post. Thanks, Chandoo!