Looking up when data won’t play nice – few more alternatives

Share

Facebook
Twitter
LinkedIn

Recently, we discussed about the case of unwieldy data and how we lookup what we want using formulas like SUMIFS. Today, let us learn few more ways to solve the same problem.

First, a re-cap of the problem:

Here is a data-set:

2D Lookup problem - Example dataset

The problem – build a lookup formula

And the problem. Oh, simple. Write a lookup formula to find how many customer walk-ins we have on any given day.

In the previous article, we discussed how to use SUMIFS to solve this problem. There were several amazing & awesome solutions shared by our readers in the comments section too.

Suitable structure spawns simple solutions

Poorly structured is the 2nd biggest problem of analysts. The first one is not enough coffee. That is why there is a dictum in the data analytics world.

Structure is everything

So, we can easily solve our lookup problem, if our data were to magically re-arranged in 2 column fashion – Data & Value.

Transforming data to solve problem easily - Example

This transformation can be done in 2 ways:

Option #1: Transforming Data – Using Formulas

We can use data fetching formulas like OFFSET or INDEX to re-arrange data in 2 columns.

Assuming,

  • Our 2D data is in a named range data,
  • There are running numbers starting with 0 in the cell J5

We can use below formula to fetch first column:

=IFERROR(INDEX(data,2*(INT(J5/7))+1,MOD(J5,7)+1),"")

for the second column, below formula works:

=IFERROR(INDEX(data,2*(INT(J5/7)+1),MOD(J5,7)+1),"")

How does this formula work?

I will explain the formula for first column. Deciphering 2nd column formula is your homework.

Here is the formula again: =IFERROR(INDEX(data,2*(INT(J5/7))+1,MOD(J5,7)+1),"")

Before understanding the formula, let’s take a minute to examine the structure of  our raw data.

  • Odd rows contain dates
  • Even rows contain values
  • There are 7 columns in total
  • So to get the first date, we need to go to row 1 (first odd number), column 1
  • To get the first value, we need to go to row 2 (first even number), column 1
  • But to get 8th date, we need to go to row 3(2nd odd number), column 1
  • So on

Let’s go from inside out.

  • 2*(INT(J5/7))+1 portion: This gives row number (ie odd number). J5 refers to running number and its value is 0. So we get 2*(INT(0/7))+1 = 1
    • This will be 3 when J5 becomes J12 (ie 8th date)
  • MOD(J5,7)+1 portion: This gives column number. It will result in values 1 thru 7 in a cyclical fashion. Thanks to MOD.
  • INDEX(data, ..., ...) portion: Now that we have both row & column numbers, INDEX formula kicks in and gets the corresponding date.
  • IFERROR(INDEX(...),"") portion: This is to help in case we ran out of all dates & values in our INDEX formula. Read about IFERROR here.

Once you have the formulas for first date & value, simply drag them to get rest of the values.

Option #2: Transforming data – Using VBA

VBA Macros are perfect for scenarios like this. Usually transformation is something you need to do every-time you import data from external systems. So simply write a macro that can do this automatically.

Assuming our data is in the range data and the first cell of our extraction range is startHere, you can use below macro:


Sub rearrangeData()
    'takes the values in DATA named range and rearranges them
    'from the named cell startHere

    Dim cell As Range, i As Long, j As Long, evenRow As Boolean, firstRow As Long
    
    i = 0
    j = 0
    firstRow = Range("data").Cells(1).Row
    
    For Each cell In Range("data")
        evenRow = (cell.Row - firstRow + 1) Mod 2 = 0
        If evenRow Then
            Range("startHere").Offset(j, 1).Value = cell.Value
            j = j + 1
        Else
            Range("startHere").Offset(i, 0).Value = cell.Value
            i = i + 1
        End If        
    Next cell
End Sub

How does this macro work?
Before jumping in to the lines of code and demystifying the logic, Let’s understand what we need to do:

  1. For each cell of data,
    1. If it is in odd row, put the cell data in Date column at end
    2. Else, put the cell data in Value column at end
  2. Repeat

This is what our code is trying to do.

Let’s examine the For Each loop, as this is the most critical part of our macro.

  • For each cell in the range data
  • We check if we are in evenRow using simple arithmetic on row numbers
  • If we are in evenRow then
    • We put the cell value in row j (number of values so far), column 2
    • We increment j
  • Else
    • We put the cell value in row i (number of dates so far), column 1
    • We increment i
  • Close the IF condition
  • We check for next cell in the data range

Advantages of Transformation over SUMIFS approach

Both options for transforming data have few advantages:

  • They work with any type of data (unlike SUMIFS, which works only for numeric lookups and has few other issues)
  • Once data is restructured, you can do other types of analysis like creating pivot tables, adding extra calculated columns etc. easily.

Download Example Workbook

Click here to download example workbook that shows original SUMIFS solution, both options for transforming data & few other formulas. Play with it to learn more. Check out the code by pressing ALT+F11.

How would you transform data?

My favorite techniques for transforming data are – VBA, formulas, Power Query, pivot tables & SQL. Depending on the situation, time availability, where my data is, I choose one of these options to scrub my data.

What about you? How do you clean up / scrub data like this? Please share you thoughts & tips with us in comments.

Instructions for washing your dirty data

If your work involves scrubbing dirty data, check out below tutorials too:


Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

28 Responses to “2010 Calendar – Excel Template [Downloads]”

  1. [...] Download and print the calendars today. You can add notes to individual dates or complete … [...] Uni Ego / Free 2010 Calendar – Download and Print Year 2010 Calendar today [...]

  2. William says:

    Afternoon,

    I have one similar calander that I added conditional formatting to so that I could highlight any planned factory holidays. I think i "borrowed" the formula from another calander so I won't post it here.

    I also added week numbers to it using the formula =WEEKNUM(MAX(C6:I6)) Where C6:I6 is the range of dates in that give week. It works fine on most of the months but return strange values on other months (Week 6 in October?) I can't see any logic behind why it does this.
    Any suggestions for an alternative formula to give the week numbers?

    Regards,

    William

  3. Miguel says:

    Hi Chandoo,
    I've added a new feature on your spreadsheet.
    This control can be useful for all the sheets where you need to check dates.

    Cheers

    http://cid-69a78592a23a8438.skydrive.live.com/self.aspx/.Public/2010-calendar%5E_Miguel.xls

  4. Nimesh says:

    Hi Chandoo,

    Nice calendar.
    Till now whichever calendar I saw in Excel, it contained only the outline sheet.
    Good to see monthly views and the mini view too.
    Liked the mini view much. 🙂

    -Nimesh

  5. Chandoo says:

    @William: This weeknum may be because the input dates to max are not properly formatting as excel dates.

    Good tip on the conditional formatting and holidays btw...

    @Migueal: Now that is super awesome. This is the reason why I love to blog. Readers will always one up me with such cool alternatives. Thank you for sharing this with us.

    @Nimesh: You are welcome 🙂

  6. Shish says:

    is it possible to get the Notes section on the outline page to display the notes added to the month page for a specific date?

    So if you add thing for January 2nd, and then select January 2nd those notes appear on the outline page

  7. Chandoo says:

    @Shish... You can do that using some formula magic. I would not recommend pushing excel to that as outlook / google calendar / icalc etc. do exactly that much more elegantly.

  8. Jörg says:

    Happy christmas to all of you!
    This is really awesome. The nicest calender I've seen for Excel. I also like Miguels version of the sheet.

    Just one "feature" is missing to me. As I live in Germany - where weeks start on Monday - I'd like to change this. Could someone please give me a hint how to do this?

    Thanks in advance

    Jörg

  9. Pedro says:

    Hi Chandoo, I’ve added some new features on your spreadsheet with your permission.

    Check it here:
    http://cid-6b219f16da7128e3.skydrive.live.com/self.aspx/.Public/Calendar%5E_Pedro.xlsm

    Miguel, this calendar is translated to Spanish language.

    Jörg, this new approach allows us to start weeks on Monday.

    Also it's possible to start weeks on Sunday if you enable Excel macros and push the arrows.
    Best Regards,
    Pedro.

  10. Chandoo says:

    @Pedro.. superb stuff.. thanks for sharing the file with all of us.

  11. Pedro says:

    Hi Chandoo, for dates before March 1, 1900 our calendars are wrong.
    In Microsoft Excel, DATE, EOMONTH, WEEKDAY functions return an incorrect result between Monday, January 1, 1900 and Wednesday, February 28, 1900.
    See this page: http://support.microsoft.com/kb/214326/en-us/
    Microsoft Excel incorrectly assumes that the year 1900 is a leap year in all Excel versions.
    That's the reason why our calendar versions only work from March, 1, 1900 until December, 31, 9999.
    Your comments are welcome.
    Pedro.

  12. Chandoo says:

    @Pedro.. Thanks for pointing that out. wow... This reminds me of the Joel Spolsky's first BillG review - http://www.joelonsoftware.com/items/2006/06/16.html (read it, I am sure you would love it.) when Bill out of blue asks about date time implementations for VBA (which Joel is the program manager for...)

    Thanks for sharing the URL too... Here is a specially made, chocolate sprinkled, extra fluffy donut for you 🙂

  13. Pedro says:

    Hi Chandoo, thanks a lot for the donut but I prefer it without chocolate!

    Always it's good to know a little history of Excel.
    The Joel Spolsky’s last BillG Excel review was about the "Hall of Tortured Souls"
    (See this Excel 95 Easter Egg here: http://www.eeggs.com/items/719.html)

    Do not miss the humor!

  14. Pedro says:

    @Chandoo.. I just return with a new calendar version.
    http://cid-6b219f16da7128e3.skydrive.live.com/self.aspx/.Public/calendar-pedrowave.xltx

    It helped me to practice conditional formatting, formulas to show check boxes, data validation drop down list, find out Thanksgiving Day's date for any year, how to find dates of public holidays using Excel, all reading your wonderful posts!

  15. Pedro says:

    Perpetual Calendar Spanish version starting weeks on Monday:
    http://cid-6b219f16da7128e3.skydrive.live.com/self.aspx/.Public/calendario-pedrowave.xltx
    Main characteristics:
    - Not macros.
    - Select a year from 1900 to 9999 with a dropdown listbox.
    - All date fields with the real date format.
    - Easy language change of day of the week and month names because are also dates.
    - Hide Saturdays and/or Sundays.
    - Week starting on Sunday or Monday.
    - Week and month numbers.
    - Hyperlink between sheets.
    - Consistent colors to Holidays, Diary and Events dates.
    - Easy change of Holidays by country.
    - Include 80 World Days and you can add more.
    - A diary with my birthday and 50 more programable appointments.
    - Check box to hide individual dates or all.
    - Holidays, diary and events text are showed on each month's sheet.
    - Ranges defined with Name Manager variables.
    I'll appreciate if you make me some suggestions to improve this calendar.
    Pedro.

  16. Joco1114 says:

    Please, I need help!
    I like all calendar from Pedro, thank you for them. Let me show my problem:

    I have 2 excel cells (for example AE12 and AE13) which mean the starting and the ending date of my duty. I need a macro to insert sheets with label YEAR. MONTH (for example 2010. August or similar) with the proper datas between the two dates. Is it possible?

    Thank you for reading me and sorry about my terribel english! 🙂

  17. Peter says:

    Hello Pedro,

    Thanks so much for the modified calendar template. I love the extra functionality you added. Is there any way you could upload an unlocked version? I wanted to change some of the comments and data validation so I could use it for one of my applications.

    As for feedback on potential improvements, with all the additions you made the file runs pretty slow. I'm sure this has to do with all the interconnectivity between the various tabs, but if there is a way to use less memory via more efficient formulas or something else I think this would make it easier to use. I have a brand new computer and with it running alone the response was pretty slow. One of the changes I'm making is changing the order of the months to match my company's fiscal year, so maybe something to automate a change like that could be useful.

    Cheers,

    Peter

  18. Pedro Wave says:

    Peter, my calendars are unlocked but you need Excel 2007 and 2010 versions to open them.

    Now I return with a new Programmable Task Calendar:
    http://cid-6b219f16da7128e3.office.live.com/view.aspx/.Public/Calendario%20de%20Tareas.xlsx

    Wath an introductory video here:
    http://pedrowave.blogspot.com/2010/10/programmable-task-calendar.html

    This new calendar allows to select the start month to match the school and fiscal year.

  19. ASA says:

    This is great stuff Chandoo and company

    Wanted to know if someone had built something similar

    I need to store one Excel Sheet on this calendar that has all the holidays

    US Holidays appear in RED
    UK Holidays appear in Blue
    Meetings appear in Green
    Submissions appear in Orange

    Is there a way I can store the list in a separate worksheet and all the calendars get updated with this?

    Thanks

  20. divya says:

    please tell me "how to convert Rs.10000/- in to words through excel formula

  21. [...] is all! http://chandoo.org/wp/2009/12/11/2010-calendar-excel-template-downloads/ See more Templates at http://www.vertex42.com/ Share this:Like this:LikeBe the first to like this [...]

  22. Kerisa says:

    Greetings,

    Thanks for this wonderful excel vacation tracker. I notice that the tracker only has three months November, December and January 2015, however, I would like to add the other ten months for 2014. Can you please instruct me on how I can add the other months?
    Thanking you in advance.

  23. kanu bhatia says:

    Hi Chandoo,
    Calendar: can this be printed as single sheet 8.5x11 inch per month
    kanu

  24. Rahul says:

    WOW! I just searching some of like this, that help me.
    Thank you for sharing.

Leave a Reply