Big trouble in little spreadsheet

Share

Facebook
Twitter
LinkedIn

Howdy folks. Jeff here. I recently gave a presentation on Excel efficiency to a bunch of analysts, in which – among other things – I’d pointed out that if you ever find yourself having to switch calculation to Manual, there’s probably something wrong with your spreadsheet. Here’s the slide:
 
Chandoo_Big Trouble in Little Spreadsheet_Slide

This prompted one of the participants to come to me for advise regarding restructuring a spreadsheet with that very problem. This analyst had a file with only 6000 rows of data in it, but the file size was something like 35MB, and after each and every change she had to wait at least a minute for the file to recalculate before she could do something else.

It turns out there were two problems with her files that were easy to resolve.

The Confused range

First, there was a problem with the Used Range – the area within a worksheet that Excel thinks contains all your workings and data. You can find out what this is for each spreadsheet by pushing [Ctrl] + [End], and seeing what cell this takes you to. Hopefully it will take you to the bottom-most, right-most cell that you’ve actually used in the sheet:
Chandoo_Big Trouble in Little Spreadsheet_Good Used Range

 

But occasionally, you’ll see that it might take you far, far below that cell. Maybe all the way to the very bottom of the grid:
Chandoo_Big Trouble in Little Spreadsheet_Bad Used Range
 
This is bad. Why? Because when Excel saves a file, it includes information about things such as what type of Cell Formatting is used within the used range. If the used range includes millions of cells that aren’t even used, then the information that Excel saves regarding these cells can really blow out the file size. This is exactly what had happened in the case of the spreadsheet concerned. After we reset the used range, the filesize plummeted from 35MB to around 2MB.

Often you can reset the Used Range simply by selecting all the the empty rows under your data, and then deleting them. To do this, select the entire row immediately below your data, then press [Ctrl] + [Down Arrow] to extend the selection right to the bottom of the sheet, then right click and select Delete:
Chandoo_Big Trouble in Little Spreadsheet_Delete

Note that you’ve got to use the Right-Click>DELETE option, NOT the Delete key on the keyboard. Pushing that Delete key does not reset the used range. In fact, this is often why the used range is wrong…it still reflects some data that used to be in the sheet, but that the user subsequently deleted using the keyboard.

When you’ve done this, then push [Ctrl] + [End] again and see where you end up – hopefully at the bottom right corner of your data.

Sometimes this doesn’t fix the problem, and you still find yourself well below your data. In this case, a bit of VBA will usually suffice. I’d suggest putting the below code into your Personal Macro Workbook, for times like this:


Sub ResetUsedRange()
Dim sht As Worksheet
Dim lng As Long

For Each sht In ActiveWorkbook.Worksheets
lng = sht.UsedRange.Rows.Count
Next
End Sub

To see what to do with this code, read What would James Bond have in his Personal Macro Workbook.

Too much SUMIF

The second problem is that each file contained something like 60,000 SUMIF formulas in them. And each one of these formulas referenced two entire columns, rather than just the 2500 rows that actually contained data. It’s really easy to see just how big a problem you might have, simply by doing a Find All for the name of the particular function you’re after:
 
Chandoo_Big Trouble in Little Spreadsheet_Find

You can throw 60,000 VLOOKUPS or IF statements or other run-of-the-mill functions at Excel and it won’t even blink. But 60,000 resource-intensive number-crunching functions such as SUMIF, SUMPRODUCT, COUNTIF etc pointed at very large ranges will cause Excel to flinch, if not shut it’s eyes completely for large periods of time.

That’s because these functions are like Ferrari’s…very powerful, but very expensive. One SUMIF is going to travel very fast down the highway. A few hundred SUMIFS on the same stretch are still going to whiz by pretty fast. Tens of thousands of them are just going to crash in to each other:
 
Chandoo_Big Trouble in Little Spreadsheet_Crashed Ferraris
 
(The image above comes from this New York Times article detailing a spectacular traffic pileup in Japan in 2011 that left a highway strewn with the smashed wreckage of eight Ferrari’s, a Lamborghini and three Mercedes sports cars. No-one seriously hurt apart from severely injured pride and a marked increase in insurance premiums the following year.)

Often you can use a PivotTable to do the same thing as a whole bunch of functions like SUMIF, COUNTIF, SUMPRODUCT et cetera. PivotTables are natural aggregation and filtering tools. In this case I could use just one PivotTable to replace those 60,000 SUMIFs, and recalculation time dropped from minutes to milliseconds. Now, reporting on this business process is effortless.

One spreadsheet, two morals

I’ve got two morals to share regarding this.

The first is to keep your eyes peeled for signs of trouble in your spreadsheets. Think of FileSize and Recalculation Time as the rev-counter of your car…if it’s getting further and further into the red, then pull over, and check under the hood.

The second – and I can’t underscore this enough – is the importance to organizations of educating all users on how to recognize symptoms of inefficiency. They don’t all have to know how to treat it (although that would be good), but just how to diagnose it. Because if it goes undiagnosed, avoidable inefficiency imposes significant, on-going, and very real opportunity cost. A real dollar amount.

Raising awareness of danger signs is possibly the biggest efficiency gain and risk-reducing opportunity that any training initiative can offer, at the least cost. It’s a game-changer.

Two morals, multiple remedies.

Over at the Daily Dose of Excel blog, I recently posted a mock business case centered around corporate investment in Excel training programme. There’s much more food for thought there, and even more in the comments, so go take a look, and please do leave a comment there with your own thoughts.

While this business case revolves around an internal corporate training programme, another great way of reducing this opportunity cost is through courses such as Chandoo.org’s own Excel School, VBA Classes, and other Chandoo courses.
excel-school-v5-1

Not to mention other fantastic courses that you’ll find advertised on the web if you look.

And yet another is though interactions in places like the Chandoo Forum, where you’ll find an army of ninjas with more collective experience than the Borg from Star Trek. The hive mind that is a forum knows no equal.

And of course, you’ll find a wealth of information on this very blog, in articles like I said your spreadsheet is really FAT, not real PHAT!

About the Author.

Jeff Weir – a local of Galactic North up there in Windy Wellington, New Zealand – is more volatile than INDIRECT and more random than RAND. In fact, his state of mind can be pretty much summed up by this:

=NOT(EVEN(PROPER(OR(RIGHT(TODAY())))))

That’s right, pure #VALUE!

Find out more at http:www.heavydutydecisions.co.nz

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

39 Responses to “Make a Quick Thermometer Chart to Compare Targets and Actuals”

  1. Jon Peltier says:

    You'll probably have some readers insist on bullet charts, which in my experience are no easier to read.

    Note on the case where actuals may exceed targets, the target has to be the second series in the chart, not the first, so it appears in front of the actual.

  2. Chandoo says:

    @Jon.. good point. And yes, readers are already saying bullets are the way to go. Atleast @dmgerbino said it on twitter: http://twitter.com/dmgerbino/status/6761754333

    But I feel the same as you did. Bullets need orientation to get started and not that easy to construct (here is a tutorial btw... http://chandoo.org/wp/2008/07/21/dashboard-bullet-graphs-excel/ )

    When you just have to compare 2 sets of values, a chart like above is good and easy enough.

    And yes, thank you for saying that data series order should be correct to show the target on top.

  3. Tony Rose says:

    I think bullet charts are a good alternative. I'm not a huge fan of the formatting that you used above where the outline is so thick.

    Another option would be to combine a line graph (plan/goal amounts) with the columns (actual) and select the option to remove the line. This leaves just the value (marker), which can be increased in size to leave only a line about the size of the bar. It's an easy and cleaner way to show actual to plan/goal. Does that make sense?

  4. Jon Peltier says:

    Tony -

    I would use columns (or area) for goal, and lines and markers for actual.

  5. Matt says:

    What about if you go over the target? The chart doesn't work so well then.

  6. The technique described today is a near bullet chart. As I stated early this morning on Twitter (link: http://bit.ly/4K3yPM ) , I am a fan of Stephen Few's Bullet Graph.

    Hubert Urruttia and I started with Charlie Kyd's method, but as Jon Peltier and Chandoo said, they are not easy to contruct. We moved onto prototyping with Fabrice Rimlinger's SPARKLINES FOR EXCEL and now use XLCube's (BonaVista) Micro Chart tool. Both of these tools allow you to create bullet charts just as easy as any Excel chart type.

    As far as reading and interpreting them, this chart type has been the easiest for us to present.

    There are many chart types. Today's "Make a Quick Thermometer Chart to Compare Targets and Actuals" is fine for a start, but your ultimate goal should be to create Bullet Graphs. AS Stephen Few states in his overview, "The bullet graph was developed to replace the meters and gauges that are often used on dashboards. Its linear and no-frills design provides a rich display of data in a small space, which is essential on a dashboard. Like most meters and gauges, bullet graphs feature a single quantitative measure (for example, year-to-date revenue) along with complementary measures to enrich the meaning of the featured measure. Specifically, bullet graphs support the comparison of the featured measure to one or more related measures (for example, a target or the same measure at some point in the past, such as a year ago) and relate the featured measure to defined quantitative ranges that declare its qualitative state (for example, good, satisfactory, and poor). Its linear design not only gives it a small footprint, but also supports more efficient reading than radial meters."

    @dmgerbino

  7. Since @dmgerbino had to bring my name up I guess I should throw in my two cents.

    @dmgerbino and I have both implemented Bullet Charts with great success. What is most interesting about this fact is that we have had a harder time implementing Sparklines than Bullet Charts. The reason for this revolves around the simple fact of familiarity. I will explain. People look at a Sparkline and they think it is a really small Line Chart and it is not. People are familiar with Line Charts since they have been around since 1786 when they were created by William Playfair. Bullet Charts on the other hand are different so they almost demand an explanation. Because of this there was a lot of face time that was needed to explain these charts but once people got them they understood the concept. This is similar to when I introduced Cycle Plots http://bit.ly/87ydVG (Thank you @nbrgraphs!) or Horizon Charts http://bit.ly/6PVavj.

    Now about the Thermometer Charts… The first thing I want to address is Tony Rose’s statement. I totally agree that the outline on the chart is too think. It might come of as being a whole new series or a new variable. What I have done in instances like this is I have created a Bar Graph and Scatter Plot mixture. Then I have turned off the Data Series on the Scatter Plot and turned on the Horrizontal Error Bars on the Scatter Plot. The new horizontal line stands for the Plan and the Bar is the actual. The reason why I find this more useful is because this technique works if you have exceeded plan. Actually, I do not understand how Chandoo’s method would display the data if Plan is surpassed.

    This reminds me of another blog post that @dmgerbino, @Jon_Peltier, and myself commented on over a year ago. http://bit.ly/PNdO Actually, I talk about similar things in regards to familiarity to charting techniques.

    - @hubert_urruttia

  8. [...] we have a post on using thermometer charts to quickly compare actual values with targets. Today we follow up the post with 10 charting ideas you can use to compare actual values with [...]

  9. Rajiv says:

    Hi Chandoo

    How do I increase the width of the bar chart and also make the long axis labels come in the same line?

    Thank you,

    Rajiv

  10. Hui... says:

    @Rajiv
    Select the outer part of the chart "Chart Area" and note the cursor will change to arrows
    drag the edges to what ever size you want
    You can hold the Alt key as you drag and the chart will snap to the cell boundaries

    Now click on the chart area inside the chart "Plot Area" and note that a box with small circles appears around it
    drag the circles on the edge of that box to suit
    You can hold the Alt key as you drag and the chart will snap to the cell boundaries

  11. Rajiv says:

    @ Hui
    Thank you for your comments. But my question was not for the "Plot Area" instead I wanted to know about how should I increase the width of the individual bar charts because with my data all the individual bars are coming to be thin and I want to make them appear broader.
    Thank You

  12. Hui... says:

    @Rajiv
    Right click on the Series you want to change and select Format Data Series
    Under Series Options goto Gap Width and decrease it to suit

  13. KH says:

    Thank you for the great chart and explanation!

  14. CL says:

    How do I show two amounts (Signed Revenue and Pipeline) as stacked within the Target amount?

  15. CL says:

    Chandoo - thanks for the quick response! What if I want the data label for the pipeline to be the actual pipeline value, not the signed rev + pipeline value? i.e. 15 instead of 55

    Thanks!

  16. Jimmy says:

    How would i do this in excel 2003?

  17. [...] Thermo-meter charts are very good to show how actual value compares with target (or budget). But how can we add another point for say Last Year value to the chart with out cluttering it. [...]

  18. Eric says:

    Hi Guys,
     
    As Matt said,
    "What if you if you go over the target?" 
    Is there a way to make it change color? or at least to show what the target  was?
    I am planning to use this with a "Forecasted vs Real" production chart but I do not know how  to show overproduction.
    Any clue?
    Thanks

  19. Jennifer says:

    How do I do this if I have 2 bars I want side-by-side?  ie 2012 Mean with 2012 benchmark overlapping and then 2013 mean with 2013 benchmark overlapping? I want the 2012 and 2012 mean bars sie by side to compare multiple categories. 

  20. Temma says:

    I have a problem in that my PM wants a chart that shows a stacked column (Labor and Expense) and then have the overall buget shown as a thermo.

    Everytime I try to do this, I either end up with all three being stacked or all of them being seperated. 

    Help?

    • Temma says:

      Or if someone knows how to only outline the top and sides of a chart series....then I would have this solved. (Make a stacked column with labor, expenses, and remaining budget, then clear the fill and outline only the top and sides.)  I just can't figure out how to do that/ not sure if excel will let me only outline part of a chart series.

  21. testdomain says:

    Your home is valueble for me. Thanks!...

  22. Sandra says:

    I've created the thermometer chart as the Chandoo tutorial described. How do I move my columns closer together? I don't want wider columns; I want to move my narrow columns closer together. Thank you!

  23. Abhinav says:

    Dear Elite members,
    could you please let me informed whether we could incorporate color formating in this thermometer approach i.e. if my actual performance is <Min then meter color sud go Red, in between min & target it sud change to Amber & target and above sud change to Green. pls advise. thanks,

    • Rick says:

      I think the only way to do that would be with VBA programming.

    • Hui... says:

      @Abhinav
      Yes, Simply use a stacked column chart, colored appropriately
      Or
      You may also want to read about Bullet Charts

      • Abhinav says:

        @ Hui,
        Could you pls demonstrate this with the help of an example.
        let's have the below sample data

        Actual=12
        Min=10
        Target=15
        Max=20

        if Actual>=Min then bar color sud be Red
        in between Min & Target= Amber
        between target(inclusive) & Max = Green
        greater than or equal to Max= Blue

        Thanks in advance

        Abhi

  24. Rick says:

    Great blog post with awesome sample data. I've implemented two of the top "power tips" by changing the colour of the actual values, AND setting Actual to be 40% transparent. Looking good.

  25. […] easy with these charts. Use them sparingly. As a rule a thermo-meter chart would be better (easy to make, takes less space, scalable) for situations like […]

  26. […] easy with these charts. Use them sparingly. As a rule a thermo-meter chart would be better (easy to make, takes less space, scalable) for situations like […]

  27. Chief449 says:

    I recently purchased the template bundle and love the ease of use - thank you!

    I would like to ask if it is possible to add an important 'block' to the dashboard to illustrate an important status for my executive team; 'billing status'? (ie budget / amount billed) something like that?

    Thank you!

    • Chandoo says:

      @Cheif449.. Thanks for your purchase and kind words.

      You can add this easily to the dashboard. Follow below steps.

      1. Unprotect the dashboard worksheet.
      2. Add a text box (Insert > Drawing Shapes) to the dashboard
      3. Put any text inside it as per your need.
      4. Format it as needed.
      5. Protect the dashboard again.

  28. Shaday says:

    How do you do this in Excel 2010 - I am not seeing that option in Format data series.

  29. Shilpa says:

    how would we check target and actual sale for multiple years

  30. Shilpa says:

    Select any of the bar, right click and format data series

Leave a Reply