How the tax burden has changed over the years – Excellent chart by NYTimes & Redoing it in Excel

Share

Facebook
Twitter
LinkedIn

If I need some charting inspiration, I always visit New York Times. Their interactive visualizations are some of the best you can find anywhere. Clear, beautifully crafted and powerful. Long time readers of Chandoo.org knew that I like to learn from visualizations in NY Times & redo them using Excel.

Today let me present you one such chart.

How the tax burden has changed over the years – Visual story by NY Times

First take a look at this story on New York times website. Go ahead and check it out, I will wait for you.

Back already. Good.

Now that you have seen a well presented story with the support of panel charts, let us learn how to re-create such charts using Excel.

Look at the tax burden Excel chart

Take a look at the excel implementation of this chart below. Read on to learn how to create this.

Tax burden over years chart - recreated in Excel

 

[click here to see larger version]

Recipe for creating this chart using Excel

We need below ingredients to make this chart using Excel

  • Raw data
  • One area chart and few lines on top
  • Simple formulas
  • One Slicer (to select an year)
  • One large cup of coffee or whatever else that you gulp

So if you are ready, lets start cooking.

Step 0: Arrange data

This is a prerequisite for any charting exercise. Although we can work with data in any shape, for quick results, arrange your data in this format:

Data for tax burden chart

In the example file you will find data for overall tax burden for all 9 tax brackets in the years 1980-2010.

Step 1: Create an area chart from all the data

Simple, select tax bracket & tax percentage rows and create an area chart. This is how it should look.

Step 1: Create an area chart from all data - tax burden chart in Excel

Step 2: Insert 2 columns after every tax bracket in your source data

Very simple, just add 2 blank columns after every tax bracket to your source data. This will change your chart to,

Step 2: Insert 2 columns after every tax bracket in your source data - tax burden chart in Excel

Step 3: Adjust data settings so that blank cells are treated as gaps

Right click on the chart, go to Select Data > Hidden & Empty cells

Specify that all blank cells should be treated as gaps. See below.

Step 3.1: Treating blank cells as gaps - tax burden chart in Excel

Now, your chart should look like this:

Step 3.2: area chart with gaps - tax burden chart in Excel

Step 4: Add a line to the chart & format it

Although our chart looks almost like NY Times chart, we still need to show a line on top. For this,

  1. Go to your data, reselect all the tax burden %s and copy them.
  2. Come back to the chart, select it and paste. (more on this)
  3. Excel will add this new data as another series to chart
  4. Right on this new series, choose Change series chart type
  5. Select Line chart
  6. Format the chart so that it looks like below.

step 4: add same data again and convert it in to a line - tax burden chart in Excel

Step 5: Remove grid lines & fake them using additional series

Excel chart’s grid lines always show up behind the data. For our chart, we want them on top. So let just delete grid lines and fake them using additional lines on the chart.

For this,

  1. In your data, add 9 extra rows at bottom (why 9? because we want to show one grid line for every 5% and the maximum we have is around 45%)
  2. Fill first row with 0.05, second with 0.1, third with 0.15… ninth with 0.45
  3. Copy all these and paste them in the chart. You should have nine lines across the chart.
  4. Now, format each line so that it looks like a dull white line with dashes.
  5. When you are done, the final output should look like this:

Step 5: Remove grid lines and fake them using additional series

Step 6: Remove horizontal axis (x-axis) labels & fake them too

Again, horizontal axis labels produced by Excel are useless for us. So we will create our own.

  1. First delete the existing axis.
  2. Then add a text box to the chart and place it where axis should be.
  3. Type the values 1980 few spaces 2010.
  4. Adjust the font size to 7pt.
  5. Now play with the text box until you are satisfied for one tax bracket.
  6. Then copy paste it 8 more times and adjust their positions.

Although we could automate this step, it felt un-necessary as the years are not going to change.

Our chart is almost ready

At this stage, our chart looks like below.

Step 6: remove x-axis labels and fake them using text box with 1980 spaces 2010

It is almost ready, but we need few more additions.

  • We need to add labels to first & last point in each tax bracket.
  • We need a mechanism so that user can select a particular year.
  • When any year is selected, we need to show that year’s tax burden %.

Adding labels for first and last points

This is done by adding one more series of values. This new series (lets call it label-first-last) will have values for only 1980 & 2010. Everything else will be NA().

The formula I used to generate this series is,

=IF(OR(year=1980,year=2010),taxburden,NA())

Once this series is added, we just format it so that only markers are shown (no line) and then add data labels. Format the labels to show in 0% format. Adjust their size and position.

Also add arrow shaped boxes on top to label each tax bracket.

 

Tax burden chart in Excel - after adding labels for first and last year

Enabling year selection thru Slicers

[This works only for Excel 2010 or above]

In a blank sheet type the years 1980 thru 2010. Select them and create a pivot.

Once the pivot is ready, insert a slicer for the years field.

For detailed steps on slicer creation see this illustration.

Creating years slicer using Excel 2010 - tutorial

Figuring out which year is selected

Once the slicer is ready, we need to figure out if user made a selection thru slicer. To do this,

  1. Use a simple formula to check how many values are shown in the pivot table (ex: COUNTA(pivot!A:A) )
  2. If only one value is shown, then extract it by referring to first row item in pivot (=pivot!A4)

Adding labels for selected year

Once we know which year is selected, we can easily create one more series that has NA() for all values except selected year. The rest you know.

Final outcome – Tax burden over the years chart using Excel

Tax burden over years chart - recreated in Excel

Download this example & Play with it

Click here to download the tax burden chart. Play with it to learn more. Examine the formulas in “Data” sheet & scroll down on “Chart” sheet for step by step instructions.

Do you like this chart?

I really loved how NY Times has been able to tell a very good story by using multiple panel charts. These are great way to examine multidimensional data and understand what is going on.

What about you? Do you like this chart? Please share your thoughts and ideas using comments.

More such charting inspiration

If you are looking for some fresh charting inspiration & ideas, you are at the right place. Check out these examples to get started:

Do you want to create powerful & insightful charts like these?

If you want to learn how to create these types of charts, consider enrolling in our Excel School program. Be warned, you will become unusually awesome in Excel by going thru our course 🙂

Click here to know more about Excel School.

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

54 Responses to “6 Tips for Writing Better VLOOKUPs”

  1. andrew says:

    Hi, I am loving the VLOOKUP series this week. 🙂

    Could you please expand a little on why you don't recommend using 1 or 0 in place of true or false? I am in the habit of doing this.

  2. "You can even omit the last argument if it is 0"

    Excel's default for the last argument is TRUE. Because of this, it's dangerous to omit the last arguement. I would use either FALSE or 0. Never omit if you want an exact match.

  3. Daniel Ferry says:

    Nice series, Chandoo!
    .
    Your readers may be interested to know that the quickest formula method to do lookups in Excel is an array-entered INDEX.
    .
    This is one of the many topics covered in the Excel Hero Academy:
    Excel Hero Academy
    .
    Regards,
    Daniel Ferry
    Excel Hero Academy

  4. sam says:

    1. Never use VLOOKUP/HLOOKUP - Always use Match /Index
    2. Sort your data before performing a Loookup
    3. Use 1/-1 option Match as it is at least 10 times faster than the 0 option- But modified to perform an exact match rather than an approximate match as described below
    a) A Column containing a Match Fucntion to Find the Position with the 1/-1 option
    b) A Status column containing a Index to check the status (present/not present)
    c) Multiple array entered Index colums to pick

  5. Gregory says:

    In tip number 5 you state, "you can even omit the last argument if it is 0" which is not correct. If you omit the last argument, Range_Lookup, is TRUE, as Mike Alexander points out.

  6. Sundeep says:

    Excellent series - Need some help from the expert. how easy it is to add/expand a named range in a lookup formula?

  7. Chandoo says:

    @Mike & Gregory: I am sorry for the confusion. The formula =VLOOKUP(value, range, column #) assumes last argument as TRUE.

    Where as the formula =VLOOKUP(value, range, column #, ) assumes last argument is blank or empty which internally gets treated as 0.

    And that is what I mean by you can even omit last argument. I state that "Remember, you must place a comma (,) after the column number if you are planning to use this." otherwise, this will not work.

    @Andrew: I suggest not using 0 or 1 as they are more cryptic and lead to confusion when your spreadsheet gets to someone else's hands.

    @Daniel: Thanks for that.

    @Sam: Good tips. I would just add that using VLOOKUP / HLOOKUP is ok as long as they solve the problem you have and do not take too much time. The performance improvements you get with array entered index or other techniques are minimal when dealing with small and moderately sized data sets.

  8. Hui... says:

    @Sundeep
    Very easy

    Have a read of: http://chandoo.org/wp/2009/10/15/dynamic-chart-data-series/
    Particularly Point 3. Create a new named range and type OFFSET formula

  9. Sundeep says:

    @Hui - Thanks.

    If I have a large workbook with many Vlookups and if I change the range to named range...is there an easy way to change all the formulas? It is more of wishful thinking than a question 🙂

  10. Chandoo says:

    @Sundeep... You can use Apply names from formulas ribbon to apply names to a selected range. This technique works when the ranges are mapped to static references. Dynamic refs. thru OFFSET are bit more tricky.

    You can use the find / replace to automatically replace all $A$1:$C$1000 with dynamic range lstData. See this: http://chandoo.org/wp/2009/02/17/spreadsheet-formulas-edit/

  11. Hui... says:

    @Sundeep
    On the Formulas Tab, Click on the Drop Down on the Define Name button and select Apply Names
    Select one or all Named Ranges and apply
    Excel will go through your worksheet/s and change the Ranges for Named Ranges.

  12. bill says:

    i cannot believe i missed the new to 2007 formula "IFERROR". your mention of this will help reduce the number of characters in many formulars i use (with "ISERROR") by at least 40% along with commensurate reductions in spreadsheet size and calculation speed... not to mention future reduction in typing and debugging time in formulas. thank you. and thank excel.

  13. jayank2000 says:

    Newbie here.
    I am not able to understand the Tip#1. Use of "val", "tbl". I tried and it kept on giving error.
    Chandoo's Tip#1: =VLOOKUP(valSalesPerson,tblData,3,FALSE)
    Does it need column headings? And how do you l lookup the value I am looking.
    Thanks in advance.

  14. JimH says:

    I need some help with creating a formula. I have a list of names on tab 1. (About 20) On tab 2 I have a list of names and there total sales (About 3,500) I created a name range for both the first list of names on tab 1 (Producer) and a name range for the second list on tab 2 (Agent_List) The sales on tab 2 for each producer is in the 7th colume.

    I need the formula to identify name of Producer (Tab1) from the Agent_List and then choose the total sales for that producer.

    This is the formula I put together and I only get #REF!
    VLOOKUP(PRODUCER,AGENT_LIST,7,FALSE)

  15. Hui... says:

    @JimH
    I assume you are adding a column next to the Agent_List on Tab 2 and looking up values from the Agent_List and retrieving values from the Producer list
    .
    So the format for your equation will be:
    =VLOOKUP(A2,Producer,7,FALSE)
    or
    =VLOOKUP(Agent_List,Producer,7,FALSE)
    .
    Note that the named range Producer must be at least 7 columns wide, not just Column A or you will get the #REF! error also

  16. Lala says:

    Hi

    Can anyone please help or this totally impossible in excel? I am trying to do a vlookup with a range of cells that contains "comments" in them and unsuccessful.

    Thank you

  17. Hui... says:

    @Lala
    You cannot search within comments unless you use VBA

  18. Jennie says:

    My tips are:

    Pay attention to data types - no fly if mixing text and numbers. I run into this problem a lot with files downloaded from access that have a tendency to mix data types on me when it hits excel.

    Pay attention to $ - If pulling from the same workbook, $ won't auto fill on your range and you will potentially miss hits.

    • blah blah says:

      Yeah, the data type mixing has bitten several folks I work with in the rear.

      EG: I work at a company where marketing source codes are 10-alphanumeric. But, some codes are like "12345" while others are "123abc". When access or sql dumps to excel, the numerical ones convert to numbers while the text ones stay text.

      So, what I do is create a reference column next to them in which I do a =TRIM([column]). Trim not only removes front/back spaces, it converts a value to text data type. This is useful, b/c sometimes sql db admins will store data with a fixed string length (eg: a column may get stored as char(50), which means it will have 50 chars no matter if it has to add extra spaces at the end to pad it out.) When you dump this to excel, the extra spaces remain at the end. So, the Trim command not only converts numbers to text, it removes padded spaces at the end. Very useful when working with sql dumps.

  19. ankit says:

    I have two sheets, in first sheet i have given a criteria of month (like jan, feb), then on another sheet i have month wise sheet like
    jan feb mar
    a 2 5 8
    b 5 9 8
    c 9 12 89

    now i need in first sheet if i give criteria jan then answer is 2+5+9, or if i give feb then answer is 5+9+12 and like that, how to get that??

  20. Nicole says:

    I am pretty well versed in VLOOKUP but I have a challenge I can't figure out. When I complete the VLOOKUP in one cell, it works fine. When I drag the formula down (using $ where necessary) the value from the first LOOKUP populates in the new cell. If I double click on the cell and hit 'enter' then the correct value is pulled in from the vlookup. Any suggestions why the formula isn't executing correctly until I hit enter?

    • Hui... says:

      @Nicole
      It sounds like Calculation is set to Manual
      Goto the Data Tab Calculation and set it to Automatic

      • Nicole says:

        Absolutely FANTASTIC!! Thank you so much. Slight variation on my version of Excel. I had to go to Formulas Tab then to Calculation sub-tab, Calculation Options, change setting to Automatic. Thank you thank you thank you. Saved me hours of more frustration!

  21. [...] than maybe sorted, which it usually is anyway).Use COUNTIF or MATCH to speed up calculationAs many others have pointed out, VLOOKUP returns #N/A if the lookup value is not found. Instead of using a [...]

  22. Sh says:

    I have more than 2 columns in a table I'm so confused cuz the results i get is #N/A =(

  23. Jerome says:

    I have a 2-sheet database.  Sheet 2 has a list of Accronyms in column A and their description in column B.  On sheet 1, column A is where you input your Acronym. In column B, the formula takes Acronym from column A, looks it up on sheet 2, and displays it on column B. 

    After some research, I found how to make custom text if there is not a match on the Acromyn.  The question i have is, is that when there is no text in comumn A, sheet 1, column B, sheet 1 displays my custom text "ABBREVIATION NOT FOUND".  I'm trying to write a forumla that leaves column B blank unitl there is an input in column A.

    This is my current forulma:
    =IF(ISNA(VLOOKUP(A4,Description!A:B,2,FALSE)),"ABBREVIATION NOT FOUND",(VLOOKUP(A4,Description!A:B,2,FALSE)))

    Any help out there?

    Thanks,

    Jerome

    • Chandoo says:

      Hi Jerome... Thanks for your question. Try this formula instead:

      =IF(A4<>"", IFERROR(VLOOKUP(A4,Description!A:B,2,FALSE),”ABBREVIATION NOT FOUND”), "")

      Works in XL 2007 or above. For older versions use this:

      =IF(A4<>"", IF(ISNA(VLOOKUP(A4,Description!A:B,2,FALSE)),”ABBREVIATION NOT FOUND”,(VLOOKUP(A4,Description!A:B,2,FALSE))), "")

      Btw, to learn more about IFERROR see this: http://chandoo.org/wp/2011/03/11/iferror-formula/

  24. Salvador says:

    I have 2 worksheet, the first one is like this:
    A     B     C     D
    1   DOG   1     BROWN
    1   DOG   2     WHITE
    2   CAT    1    SMALL
    2   CAT    2     MEDIUM
    2    CAT   3     BIG
    THE SECOND WORKSHEET IS LIKE THIS:
    A                  B                                         C                    D
    ENTER#      fORMULA 1 WITH VLOOK          ENTER #     FORMULA 2
                     (RETURN ANIMAL)                                    RETURN TYPE
     
    FOR EXAMPLE i NEED WORKS LIKE THIS:
    2                 CAT                               2                         MEDIUM
     
    FIRST FORMULA IS EASY NOT PROBLEM. bUT FOR THE SECOND i DO NOT FIND HOW TO DO IT. PLEASE HELP.

    • Jo says:

      This would be how I would handle your second formula, in your first worksheet, I would insert a column between C & D. In that column I would have a formula to concatenate the values in column A & C (example =concatenate(a2,c2)) which would result in:

      A B C D E
      1 DOG 1 11 BROWN
      1 DOG 2 12 WHITE
      2 CAT 1 21 SMALL
      2 CAT 2 22 MEDIUM
      2 CAT 3 23 BIG

      Then in the second worksheet formula 2 would be:

      =vlookup(concatenate($a2,$c2),AnimalType columns D&E,2,false)

  25. Gazza says:

    Great Stuff Chandoo
    In your 6th post you say use SUMIF instead of VLOOKUP as it runs faster.
    What if you have a spread sheet with repeated data and you only want to pull one value back?
    would it be best to use a simple VLOOKUP
    or something like: IF(COUNTIF < 2, SUMIF, VLOOKUP)
    I have set COUNTIF < 2 (not just = 1) to take advantage of the fact that if COUNTIF = 0 you won’t get an error

  26. Jo says:

    Now if only you could use the column header name instead of the column index number in the VLOOKUP function.

    Scenario: I have a list/table in one spreadsheet that I use to lookup values in other spreadsheets. If I insert columns in my list/table, I have to go into the other spreadsheet(s) and increment the VLOOKUP formulas' column index number to capture the right column of values.

    Example: if I inserted a column in Table1, my formula:
    =VLOOKUP(A1,Table1,2,FALSE) would have to change to:
    =VLOOKUP(A1,Table1,3,FALSE),
    it would be so much better if you could code something like:
    =VLOOKUP(A1,Table1,Table1[price],FALSE)

    If my lookup result is numeric data I could use sumif as suggested and use the list/table references; is there a similar function I can use for alphanumeric data lookups that uses list/table references?

  27. andy says:

    tip:

    you can use dynamic column reference for your look up if you want to pull multiple column values from another sheet with the same row reference without having to rewrite the the formula, e.g.

    range a1:d1 = "header", 2 , 3, 4
    b2 = vlookup($a2, LookUpRange, b$2, 0)
    c2 = vlookup($a2, LookUpRange, c$2, 0)
    b3 = vlookup($a3, LookUpRange, b$2, 0)

    the above will bring back the value two columns away from LookUpRange in b2, 3 for c2 and 4 for d2 for the same reference, a2. By freezing just the column for your lookup reference value and just the rows for your column reference, you can drag your forums both down and right while keeping all reference both constant and dynamic... as oxymoronic as that sounds.

    • chris says:

      my TIP, building on what Andy says above re using a dynamic refrence: if you use the column functon in the header row - should someone add extra columns to the source sheet your lookup will adapt and still return the right result.

  28. Chaz says:

    With the below formula I am getting "too many arguments for this function. any help?

    =IFERROR(VLOOKUP(RIGHT(M3,7),notes!A:A,1,FALSE),"Failure to process correctly",IFERROR(VLOOKUP(RIGHT(n,2),notes!A:A,1,FALSE),"Failure to process correctly"))

  29. WelshIan says:

    Chaz - IFERROR only requires 2 arguments, you have entered 3 (the vlookup, the error message, the 2nd IFERROR).

    Change your formula to the following:

    =IF(isERROR(VLOOKUP(RIGHT(M3,7),notes!A:A,1,FALSE)),”Failure to process correctly”,IFERROR(VLOOKUP(RIGHT(n,2),notes!A:A,1,FALSE),”Failure to process correctly”))

    Ian

    • WelshIan says:

      Hmm, I'm not sure my formula will return the required output.

      This tests if there is an error in the 1st vlookup, then checks the 2nd, and only returns the error message if both vlookups are errors. Is that what you wanted to do?
      =IF(isERROR(VLOOKUP(RIGHT(M3,7),notes!A:A,1,FALSE)),IFERROR(VLOOKUP(RIGHT(n,2),notes!A:A,1,FALSE),”Failure to process correctly”),VLOOKUP(RIGHT(M3,7),notes!A:A,1,FALSE))

  30. erik says:

    I am trying to use a vlookup with a named range for the lookup array. This works fine. However now I would like to replace this named range with a cell reference (which obviously contains the name of the named range) but get a N/A error message. Is this really not possible?

    vlookup ( A1, named range, 2, 0 ) . This works
    vlookup ( A1, F1, 2, 0 ) . Where cell F1 contains the the text with named range. This does not work.

    Any tips or thoughts would be appreciated. Thank you in advance

  31. erik says:

    Works like a charm. Thank you!

  32. Matt says:

    Some opinions on the pros and cons of using named ranges on http://www.excelvlookuphelp.com along with a few other hot tips

  33. d j says:

    Hello,
    Chandoo,

    Can u explain me how to use vlookup formula in 2 sheets in one excel workbook.

  34. Satish says:

    Hi am Using Index match function to overcome the limitation of Vlookup. But I am failed to get the same result as i get in Vlookup. in vlookup as we can expand the Columns of Vlookup in one single shot. Like Vlookup($A4,A1:G9,3,0) but same Result i Not get in Index match Function. Please help

  35. Sean Burke says:

    Dear Excel super-users,

    Sourcing data from different sheets.

    I'd like to specify in the vlookup formula which sheet to source data from.

    This source sheet will change depending of the name of the person selected in a specific cell C1 on the sheet where the vlookup formula is being run from.

    I'd be grateful for any tips to achieve this.

    Regards,

    Sean

  36. raghuwar singh bisht says:

    dear sir /madam

    please proved me lookup formula
    and exp--------- insert picture formula attched excel sheet

  37. Jayme says:

    Us the Column formula in place of the 3rd argument will save you time when you want to bring in all data columns!

Leave a Reply