Big trouble in little spreadsheet

Share

Facebook
Twitter
LinkedIn

Howdy folks. Jeff here. I recently gave a presentation on Excel efficiency to a bunch of analysts, in which – among other things – I’d pointed out that if you ever find yourself having to switch calculation to Manual, there’s probably something wrong with your spreadsheet. Here’s the slide:
 
Chandoo_Big Trouble in Little Spreadsheet_Slide

This prompted one of the participants to come to me for advise regarding restructuring a spreadsheet with that very problem. This analyst had a file with only 6000 rows of data in it, but the file size was something like 35MB, and after each and every change she had to wait at least a minute for the file to recalculate before she could do something else.

It turns out there were two problems with her files that were easy to resolve.

The Confused range

First, there was a problem with the Used Range – the area within a worksheet that Excel thinks contains all your workings and data. You can find out what this is for each spreadsheet by pushing [Ctrl] + [End], and seeing what cell this takes you to. Hopefully it will take you to the bottom-most, right-most cell that you’ve actually used in the sheet:
Chandoo_Big Trouble in Little Spreadsheet_Good Used Range

 

But occasionally, you’ll see that it might take you far, far below that cell. Maybe all the way to the very bottom of the grid:
Chandoo_Big Trouble in Little Spreadsheet_Bad Used Range
 
This is bad. Why? Because when Excel saves a file, it includes information about things such as what type of Cell Formatting is used within the used range. If the used range includes millions of cells that aren’t even used, then the information that Excel saves regarding these cells can really blow out the file size. This is exactly what had happened in the case of the spreadsheet concerned. After we reset the used range, the filesize plummeted from 35MB to around 2MB.

Often you can reset the Used Range simply by selecting all the the empty rows under your data, and then deleting them. To do this, select the entire row immediately below your data, then press [Ctrl] + [Down Arrow] to extend the selection right to the bottom of the sheet, then right click and select Delete:
Chandoo_Big Trouble in Little Spreadsheet_Delete

Note that you’ve got to use the Right-Click>DELETE option, NOT the Delete key on the keyboard. Pushing that Delete key does not reset the used range. In fact, this is often why the used range is wrong…it still reflects some data that used to be in the sheet, but that the user subsequently deleted using the keyboard.

When you’ve done this, then push [Ctrl] + [End] again and see where you end up – hopefully at the bottom right corner of your data.

Sometimes this doesn’t fix the problem, and you still find yourself well below your data. In this case, a bit of VBA will usually suffice. I’d suggest putting the below code into your Personal Macro Workbook, for times like this:


Sub ResetUsedRange()
Dim sht As Worksheet
Dim lng As Long

For Each sht In ActiveWorkbook.Worksheets
lng = sht.UsedRange.Rows.Count
Next
End Sub

To see what to do with this code, read What would James Bond have in his Personal Macro Workbook.

Too much SUMIF

The second problem is that each file contained something like 60,000 SUMIF formulas in them. And each one of these formulas referenced two entire columns, rather than just the 2500 rows that actually contained data. It’s really easy to see just how big a problem you might have, simply by doing a Find All for the name of the particular function you’re after:
 
Chandoo_Big Trouble in Little Spreadsheet_Find

You can throw 60,000 VLOOKUPS or IF statements or other run-of-the-mill functions at Excel and it won’t even blink. But 60,000 resource-intensive number-crunching functions such as SUMIF, SUMPRODUCT, COUNTIF etc pointed at very large ranges will cause Excel to flinch, if not shut it’s eyes completely for large periods of time.

That’s because these functions are like Ferrari’s…very powerful, but very expensive. One SUMIF is going to travel very fast down the highway. A few hundred SUMIFS on the same stretch are still going to whiz by pretty fast. Tens of thousands of them are just going to crash in to each other:
 
Chandoo_Big Trouble in Little Spreadsheet_Crashed Ferraris
 
(The image above comes from this New York Times article detailing a spectacular traffic pileup in Japan in 2011 that left a highway strewn with the smashed wreckage of eight Ferrari’s, a Lamborghini and three Mercedes sports cars. No-one seriously hurt apart from severely injured pride and a marked increase in insurance premiums the following year.)

Often you can use a PivotTable to do the same thing as a whole bunch of functions like SUMIF, COUNTIF, SUMPRODUCT et cetera. PivotTables are natural aggregation and filtering tools. In this case I could use just one PivotTable to replace those 60,000 SUMIFs, and recalculation time dropped from minutes to milliseconds. Now, reporting on this business process is effortless.

One spreadsheet, two morals

I’ve got two morals to share regarding this.

The first is to keep your eyes peeled for signs of trouble in your spreadsheets. Think of FileSize and Recalculation Time as the rev-counter of your car…if it’s getting further and further into the red, then pull over, and check under the hood.

The second – and I can’t underscore this enough – is the importance to organizations of educating all users on how to recognize symptoms of inefficiency. They don’t all have to know how to treat it (although that would be good), but just how to diagnose it. Because if it goes undiagnosed, avoidable inefficiency imposes significant, on-going, and very real opportunity cost. A real dollar amount.

Raising awareness of danger signs is possibly the biggest efficiency gain and risk-reducing opportunity that any training initiative can offer, at the least cost. It’s a game-changer.

Two morals, multiple remedies.

Over at the Daily Dose of Excel blog, I recently posted a mock business case centered around corporate investment in Excel training programme. There’s much more food for thought there, and even more in the comments, so go take a look, and please do leave a comment there with your own thoughts.

While this business case revolves around an internal corporate training programme, another great way of reducing this opportunity cost is through courses such as Chandoo.org’s own Excel School, VBA Classes, and other Chandoo courses.
excel-school-v5-1

Not to mention other fantastic courses that you’ll find advertised on the web if you look.

And yet another is though interactions in places like the Chandoo Forum, where you’ll find an army of ninjas with more collective experience than the Borg from Star Trek. The hive mind that is a forum knows no equal.

And of course, you’ll find a wealth of information on this very blog, in articles like I said your spreadsheet is really FAT, not real PHAT!

About the Author.

Jeff Weir – a local of Galactic North up there in Windy Wellington, New Zealand – is more volatile than INDIRECT and more random than RAND. In fact, his state of mind can be pretty much summed up by this:

=NOT(EVEN(PROPER(OR(RIGHT(TODAY())))))

That’s right, pure #VALUE!

Find out more at http:www.heavydutydecisions.co.nz

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

63 Responses to “To-do List with Priorities using Excel”

  1. Mario 8a says:

    Very useful, you always give us good ideas for our excel files. Thanks
    I've been working on calendars leagues. If you must watch a bit on my blog. http://economiaemergente.com/
     

  2. Jason says:

    EXCELLENTE!!!! 

  3. Rasheed says:

    Needed .. thanks for sharing

  4. [...] To-do List with Priorities using Excel [...]

  5. Gregg says:

    Excellent spreadsheet.  Nice work.

  6. Jose Pedro says:

    Ciao Peppe!, Tante grazie per compartire il tuo eccellentissimo lavoro in Excel. Tu hai a web blog? - Grazie Chandoo per la publicazione.
    Hello Peppe, Thank you so much for sharing your most excellent work in Excel. Have you a web blog? - Thanks Chandoo for publication.

    • PEPPE says:

      Hi Jose,
       tanks for your appreciations and tks to Chandoo for publishing
      my little job.  it's a pleasure for me to be mentioned on my guru's blog. 
      Just to reply to Jose, I don't have a blog, but if you want to share some ideas or need some help don't hesitate to contact me also on twitter like @peppinogreco.
      Regards
      Peppe 

  7. Great!
     
    I've learned a little bit of VBA during the last year, and get addicted to it, but sometimes, it makes us forget how powerful excel is, without macros.
    Nice post!
     
    Cauê

  8. Hi Chandru,
     A very good post. Though I had been reading your posts for a longer time, did not post any questions so far except for wishing and appreciating.
     I have a question here. I had attempted to do something on my own (a little R & D) on the new year resolution template itself. However, I could not do it fully.  Thankfully, you had provided the link for each step , which was exactly what I was looking for 🙂 
     I had done with the check boxes and also conditional formatting. I am glad indeed. I am able to highlight a row when a check box is checked. However, the value of the checkbox gets printed in the same cell which it was linked to. How can I avoid it ? I could not see it in the sample excel files you had provided.
     I appreciate your help in this.
     
    Cheers,
    Raghavan alias Saravanan M
    Jeddah | Kingdom of Saudi Arabia

    • Chandoo says:

      Hi Raghavan... Thanks for your comments and I am glad you are trying to build this on your own. There is no way we can avoid printing the check box value in linked cell. If you do not want to see "TRUE or FALSE" in a cell, you do one of the following.

      • Link check box to a cell in an un-used column. Then hide that column.
      • Link check box to a cell in a different sheet. Then hide that sheet.
      • Link check box to a cell and then hide the cell contents by formatting it with custom code ;;; (more on this here: http://chandoo.org/wp/2009/06/05/hide-cell/ )
  9. Daniel says:

    Dal Messico grazie tanti Peppe.

    A great idea, thanks for shearing it with all of us.
     
    Daniel
     

  10. Lovely idea - downloading now.

    What software is used to create the animated gif of the template in action?  Love to replicate to simple demos on my site.

    Cheers
    Glen 

  11. John says:

    Raghavan

    I just make the font white for the cell linked to the checkbox or if you have shading applied then font colour = shading so its there but is not seen or printed.
    John  

  12. Utku says:

    Excellent! Thank you very much.

  13. Sully says:

    Excellent thanks!

  14. Suresh says:

    Happy New Year.
    Looks simple but excellent. Never knew you could do this without VBA.
    Thanks Pepe

  15. Henrique de Albuquerque says:

    good day,
    Please, how can I create a chart with scroll bar that is also dynamic in PPT.
    I created the chart in Excel, but I need this information to be presented dynamically in powerpoint and when I put the bar rolls loses functionality. please can you help me?

  16. Benny says:

    Come nella migliore tradizione:grandi ma semplici idde dall'Italia.
    bravo Peppe

  17. Vaslo says:

    This was outstanding.  I have had two bosses give me to-do lists that I was very unhappy with.  I went and added 15 more lines to this and it was really easy to so with a little reformatting and changing some links.  THANKS!!!

  18. Aparajita says:

    Thanks. really usuful. Will be waiting for such thing in future.

  19. Juan says:

    Great tutorial! It would be interesting if someone could explain how to do the chart with detail: how to insert the values of the horizontal axis, to create the horizontal bar (the outlines) and the bar itself, etc

  20. DJ says:

    Good Concept!
    Downloaded it but, my Excel 2007 hangs and I have to recover it few times. Finally it opens but, everything is distorted.
    Am I doing something wrong?
     
    -DJ

  21. tadovn says:

    Interesting idea.
    You give e new way to track my actual planning.
    But instead of using thermometer in this case, we can use a simple bar chart , with data is the total done.
    Reasoning for that, with thermometer, you have to format all the small part of data with the same color. If you have more than 10 parts, it will take your time to finish.
    I tested and it shown the same.
     
    I'm searching for How to automatically add check box link to a new cells when we add new item?
    Thanks for your interesting idea.

  22. Munir says:

    Thank you Peppe & Chandoo for sharing an awesome idea.

  23. Sara says:

    How do i increase the list ? I cant just drag down can I ? the check boxes perform the same way

  24. RAVI XAVIER says:

    VERY EXCELLENT THANK YOU VERY MUCH.

  25. Talia says:

    How do you increase the list? Formatting of the check boxes and shading etc does not copy correctly if using copy and paste or dragging cells down...

  26. Pradeep says:

    Thanks for this useful to do list.

    I have the same question as TADOVN. This blog doesn't properly give instruction on how to add new task row. Following are my queries.

    1) How do I add a new row?
    2) If I copy paste the last row to create a new row, the check box get duplicated, i.e. if I click on the new check box on the new row, the previous check box also gets checked.

    So the simple question is.. how do I add a new row so that it behaves the same way as other rows?

  27. Angela G. says:

    Thank you very much! Great to do list template.

  28. Celine says:

    Thanks for the template.

    From an NGO organisation in Malaysia

  29. Leah says:

    Will someone please answer the question about how to add additional rows to this list? I love it, but this is a fatal flaw, as I frequently have many more tasks.

    Thank you!

    • Dennis says:

      Below is how I added additional rows:

      1) Select both columns H and N, right clicked, and clicked Unhide to reveal the formulas.
      2) Select row 12 on the To Do List, copy it, and insert it below in the next row.
      3) Change the 12 in cell C22 to a 13.
      3) Drag your mouse and copy the formulas from cells I15, J15, and K15.
      4) Paste the formulas below in cells I16, J16, and K16.
      5) Right click on the check box in cell F22.
      6) Click Format Control.
      7) Click the Control tab.
      8) In the Cell Link box, change the I15 to I16.
      9) Repeat the steps above. (Change I16 in the Cell Link box to I17...I17 to I18, etc.)
      10) If you are not seeing Format Control when you right click the check box, you need to make the Developer Tab available.

    • Dennis says:

      Leah,

      If you follow my previous instructions, you still may need to go back and change the formulas in column K. They calculate the priority weights and go in consecutive order as you go down the column:

      IFERROR(1/E10,0)
      IFERROR(1/E11,0)
      IFERROR(1/E12,0), etc.

      Some of you who are more Excel savy may be able to figure out how to copy the formulas quicker. This is just the way I figured it out.

  30. Bandula says:

    I am sure I would love this and it will help me to accomplice my tasks efficiently . Thanks Buddy

  31. Sander says:

    How would I be able to delete one of the row (not use 6 for example) so it won't calculate it with the progress?

  32. […] 42,416] Angry Formulas game… [Visitors: 36,392] Learn top 10 Excel features [Visitors: 25,723] To-do list with priorities – Excel templates [Visitors: 19,947] Introduction to Power Pivot [Visitors: 21,298] Best new features in Excel 2013 […]

  33. […] 2013 Calendar, 2012 Calendar, 2011 Calendar, New Year Resolution Tracker, Picture Calendar Template and Todo list template […]

  34. […] ?? ????? ??????????? ?????? ?????? ????? ? ????????????? ??? Excel. ??? ???? ????? ?? ??? […]

  35. Victor says:

    Thank you so much for this post. I took me a bit to figure out how the checkboxes link to the rest of the sheet, but now that I've got it I've created a new page for every day so I can track tasks going forward. I've also added work tasks side-by-side with personal tasks. Once I did that I also thought it would be neat to see how productive I am week over week so I added a nice summery page. The summary builds on the percentage completion for personal and work tasks.

    Love this template - so versatile and yet simple.

    My next project is to get standard weighting for certain tasks so I don't have to keep remembering them.

    Cheers,

    Victor

  36. Jeff Carlsen says:

    I like this template. I may modify how the checkboxes work though for a couple reasons:

    1) It's a pain to add more rows. If I want to add 10 more rows, it appears that I have to re-point each new object to the appropriate link-cell. Otherwise, they all point back to the copied row - checking one causes all of them to check.

    2) I can't group and collapse rows in the checklist without all the objects stacking together and remaining visible in the lowest non-collapsed row. With a simple "x", this would be ok.

    One solution would be to have a simple "x" instead of a checkbox object. I could just use an "x" to mark complete, and make the TRUE/FALSE based on an If formula (If "x" then TRUE; otherwise FALSE).

  37. Kris says:

    I downloaded the file, but it is a ZIP file with several subfolders and xml files. There is no workbook here. How do I open this in Excel?

    thank you for the help and excellent ideas you share.

    • Hui... says:

      @Kris
      Yes, Excel files are special Zip files that actually contain a number of files including your data
      If the file opens like that save it locally as a *.zip file and rename it to a *.xlsx file

      Open with excel normally

  38. s.f says:

    How do you change the color when it is completed....I have multiple companies and need to color code this template.

    Thank you.

  39. Callie says:

    Hello! I have added additional rows, fixed it so that the check boxes work individually, AND made it so that the #% changes when each box is checked -- however the status bar won't move past the midway mark.

    Any ideas on how I can get the progress bar to fill up the entire way once the list is complete?

    • Cheryl says:

      If you right click the status bar, select 'Select Data' and go to 'Chart Data Range' and revise to include your expanded range. The bar chart colors may default to a predefined style. Right click the chart to reformat the Chart Area.

    • Cheryl says:

      Or, to change the bar colors, I populated all rows w/ activities and rank and then left clicked the bar chart color that I wanted to change - went up to the ribbon under the home tab, selected the new bar color from the fill color dropdown.

  40. Cheryl says:

    Love the instant gratification of the status bar! Genius!

  41. Frank says:

    Thank you so much, what a great tool! God bless you for doing this for free!!

  42. rahul saldanha says:

    Awesome
    Nice to show power of excel.

  43. Hui... says:

    Over in the Chandoo.org Forums, Asshu has updated this witha VB Interface

    Have a look and use if from: http://chandoo.org/forum/threads/to-do-list-vb-interface.28973/

  44. Chirag Raval says:

    Dear All,

    There are good job done here & its very helpful for all.
    God Bless You to you all for your valuable working.
    Regards,
    Chirag

  45. Jake says:

    Hi guys,

    I've added additional rows, but the percentages in the thermo-meter don't reflect this when the boxes are checked. I'm lost with how to change this, so any assistance would be greatly appreciated!

    Jake

  46. Peggy Wong says:

    Hi Chandoo, how you do it for all this check list. it is using Excel VBA, I am not good it that.. still leaning part. and I was trying to figure out. Trying to understand all vba code and meaning and when I use which code.

    do you have any guide line on this, i mean. Exp: dim is what, string etc:

    for all this checking list does need to use VBA?

    Thankyou
    Peggy

Leave a Reply