Big trouble in little spreadsheet

Share

Facebook
Twitter
LinkedIn

Howdy folks. Jeff here. I recently gave a presentation on Excel efficiency to a bunch of analysts, in which – among other things – I’d pointed out that if you ever find yourself having to switch calculation to Manual, there’s probably something wrong with your spreadsheet. Here’s the slide:
 
Chandoo_Big Trouble in Little Spreadsheet_Slide

This prompted one of the participants to come to me for advise regarding restructuring a spreadsheet with that very problem. This analyst had a file with only 6000 rows of data in it, but the file size was something like 35MB, and after each and every change she had to wait at least a minute for the file to recalculate before she could do something else.

It turns out there were two problems with her files that were easy to resolve.

The Confused range

First, there was a problem with the Used Range – the area within a worksheet that Excel thinks contains all your workings and data. You can find out what this is for each spreadsheet by pushing [Ctrl] + [End], and seeing what cell this takes you to. Hopefully it will take you to the bottom-most, right-most cell that you’ve actually used in the sheet:
Chandoo_Big Trouble in Little Spreadsheet_Good Used Range

 

But occasionally, you’ll see that it might take you far, far below that cell. Maybe all the way to the very bottom of the grid:
Chandoo_Big Trouble in Little Spreadsheet_Bad Used Range
 
This is bad. Why? Because when Excel saves a file, it includes information about things such as what type of Cell Formatting is used within the used range. If the used range includes millions of cells that aren’t even used, then the information that Excel saves regarding these cells can really blow out the file size. This is exactly what had happened in the case of the spreadsheet concerned. After we reset the used range, the filesize plummeted from 35MB to around 2MB.

Often you can reset the Used Range simply by selecting all the the empty rows under your data, and then deleting them. To do this, select the entire row immediately below your data, then press [Ctrl] + [Down Arrow] to extend the selection right to the bottom of the sheet, then right click and select Delete:
Chandoo_Big Trouble in Little Spreadsheet_Delete

Note that you’ve got to use the Right-Click>DELETE option, NOT the Delete key on the keyboard. Pushing that Delete key does not reset the used range. In fact, this is often why the used range is wrong…it still reflects some data that used to be in the sheet, but that the user subsequently deleted using the keyboard.

When you’ve done this, then push [Ctrl] + [End] again and see where you end up – hopefully at the bottom right corner of your data.

Sometimes this doesn’t fix the problem, and you still find yourself well below your data. In this case, a bit of VBA will usually suffice. I’d suggest putting the below code into your Personal Macro Workbook, for times like this:


Sub ResetUsedRange()
Dim sht As Worksheet
Dim lng As Long

For Each sht In ActiveWorkbook.Worksheets
lng = sht.UsedRange.Rows.Count
Next
End Sub

To see what to do with this code, read What would James Bond have in his Personal Macro Workbook.

Too much SUMIF

The second problem is that each file contained something like 60,000 SUMIF formulas in them. And each one of these formulas referenced two entire columns, rather than just the 2500 rows that actually contained data. It’s really easy to see just how big a problem you might have, simply by doing a Find All for the name of the particular function you’re after:
 
Chandoo_Big Trouble in Little Spreadsheet_Find

You can throw 60,000 VLOOKUPS or IF statements or other run-of-the-mill functions at Excel and it won’t even blink. But 60,000 resource-intensive number-crunching functions such as SUMIF, SUMPRODUCT, COUNTIF etc pointed at very large ranges will cause Excel to flinch, if not shut it’s eyes completely for large periods of time.

That’s because these functions are like Ferrari’s…very powerful, but very expensive. One SUMIF is going to travel very fast down the highway. A few hundred SUMIFS on the same stretch are still going to whiz by pretty fast. Tens of thousands of them are just going to crash in to each other:
 
Chandoo_Big Trouble in Little Spreadsheet_Crashed Ferraris
 
(The image above comes from this New York Times article detailing a spectacular traffic pileup in Japan in 2011 that left a highway strewn with the smashed wreckage of eight Ferrari’s, a Lamborghini and three Mercedes sports cars. No-one seriously hurt apart from severely injured pride and a marked increase in insurance premiums the following year.)

Often you can use a PivotTable to do the same thing as a whole bunch of functions like SUMIF, COUNTIF, SUMPRODUCT et cetera. PivotTables are natural aggregation and filtering tools. In this case I could use just one PivotTable to replace those 60,000 SUMIFs, and recalculation time dropped from minutes to milliseconds. Now, reporting on this business process is effortless.

One spreadsheet, two morals

I’ve got two morals to share regarding this.

The first is to keep your eyes peeled for signs of trouble in your spreadsheets. Think of FileSize and Recalculation Time as the rev-counter of your car…if it’s getting further and further into the red, then pull over, and check under the hood.

The second – and I can’t underscore this enough – is the importance to organizations of educating all users on how to recognize symptoms of inefficiency. They don’t all have to know how to treat it (although that would be good), but just how to diagnose it. Because if it goes undiagnosed, avoidable inefficiency imposes significant, on-going, and very real opportunity cost. A real dollar amount.

Raising awareness of danger signs is possibly the biggest efficiency gain and risk-reducing opportunity that any training initiative can offer, at the least cost. It’s a game-changer.

Two morals, multiple remedies.

Over at the Daily Dose of Excel blog, I recently posted a mock business case centered around corporate investment in Excel training programme. There’s much more food for thought there, and even more in the comments, so go take a look, and please do leave a comment there with your own thoughts.

While this business case revolves around an internal corporate training programme, another great way of reducing this opportunity cost is through courses such as Chandoo.org’s own Excel School, VBA Classes, and other Chandoo courses.
excel-school-v5-1

Not to mention other fantastic courses that you’ll find advertised on the web if you look.

And yet another is though interactions in places like the Chandoo Forum, where you’ll find an army of ninjas with more collective experience than the Borg from Star Trek. The hive mind that is a forum knows no equal.

And of course, you’ll find a wealth of information on this very blog, in articles like I said your spreadsheet is really FAT, not real PHAT!

About the Author.

Jeff Weir – a local of Galactic North up there in Windy Wellington, New Zealand – is more volatile than INDIRECT and more random than RAND. In fact, his state of mind can be pretty much summed up by this:

=NOT(EVEN(PROPER(OR(RIGHT(TODAY())))))

That’s right, pure #VALUE!

Find out more at http:www.heavydutydecisions.co.nz

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

28 Responses to “Pimp your comment boxes [because it is Friday]”

  1. Jeff Weir says:

    This borders on Excel soft-cell...er, soft-core...porn. My favorite kind.

  2. Tim says:

    Wow, that is pimp-TASTIC! I have a question, as a VBA n00b: additional comment boxes stay plain unless I "run" the macro. Is there a way to change all comments, going-forward?

  3. laguerriere says:

    hi Chandoo, well, I like the macro approach. For those who don't like it, there is another way: just add the "draw" toolbar to the shapes toolbar (via Custom etc), click on "edit comment", click on the auto-shape and then choose "draw" drop-down, --> modify auto-shape --> then you even can have a heart or a banner (I like the horizontal banner in in purple :-)) . in excel 2007, you have to add this custom menu that you choose via Excel Options --> Custom --> it is called "change/ modify auto-shape"!!!
    best,

  4. Tom says:

    @Chandoo. Great Post 🙂
    @Tim : the way the macro is coded, it must be run very time.
    @Community: If someone has an idea to perform it when opening an existing excel, it should be nice.
    @Community: if someone has some code to revamp the commentboxes on all sheets, please share it. 🙂
    @Microsoft Excel-progammers: some pimpoptions for the commentboxes should be great.

    Cheerio
    Tom

  5. Yukikomi says:

    For the auto run, please add the codes in workbook:

    Private Sub Workbook_SheetActivate(ByVal Sh As Object)

    Call Comments_Tom

    End Sub

  6. Debra says:

    Wow, that was a lot of fun... Thanks Tom!

  7. Chandoo says:

    @Jeff... Now, 5000 people know about your favorite porn... 😛

    @Tim ... you can write an event to handle the new comments. I wouldnt recommend it as it is really painful. another option is to use the macro suggested by Yukikomi. It will update comments everytime you activate the sheet.

    @laguerriere: very cool 🙂

  8. Johnnie says:

    @Chandoo ... Thanks! This is good stuff. I combined your tip with a tip from Mark O'Brien, then assigned it to a button on Excel 2010's Quick Access Toolbar, to format comments AS I add them. I also like how Mark's code saves me the trouble of backspacing my name out of new comments:

    Sub AppendToExistingComment()
    'Source: Mark O'Brien at http://www.mrexcel.com/forum/showthread.php?t=57296
    Dim oRange As Range
    Dim oComment As Comment
    Dim sText As String

    'Use object variable to hold range.
    Set oRange = ActiveCell
    'Use object variable for comment
    Set oComment = oRange.Comment
    'text to be added to the comment box
    sText = InputBox("Type text to be added:", "APPEND TO COMMENT TEXT")
    If Len(sText) = 0 Then End
    'If Active Cell has a comment then append new text to the end of the comment text
    If Not oComment Is Nothing Then
    sText = oComment.Text & vbNewLine & sText
    oRange.Comment.Delete
    End If

    'Add a comment with the contents of sText
    oRange.AddComment sText

    DoEvents
    Comments_Tom

    End Sub

  9. Nick says:

    Thank you very much for the code, it seems to be working for the most part; I am having a problem however. Once the routine makes the corrections to the comment, the comment becomes invisible. By invisible, I mean that when I highlight my mouse over it, nothing appears. However, when I right click the cell and click 'edit comment' then the comment becomes visible and I enter edit mode. Upon clicking out of the comment, it simply vanishes again. I've tried to fix this problem by adding a .shape.visible = msoTrue but then every comment is always visible. o_O please advise...

    Thank you,

    Nick

  10. Shailyog says:

    @Nick- That is because the font color of the comment is white and when you select the color of selection is also white hence you can not see anything. Try to change the color code in the routine to something else. would work

  11. Michael says:

    Thanks for that! The code works perfectly!

  12. [...] look at Format Excel Comment Boxes using VBA Macros | Chandoo.org - Learn Microsoft Excel Online [...]

  13. Sunny says:

    @ Chandoo - code works great and the comments look super cool. But I have ran into a small issue. In the comments, I am inserting pictures. When I run the macro, for all comments which already have pictures; pictures are deleted. Pls help me retain the pics in comments.

  14. […] posted some code one of his readers submitted, it "pimps" your comment boxes from those boring black-text-on-yellow rectangles to something more professional and eye-pleasing. […]

  15. mohammad mal says:

    love in it

  16. Deepak says:

    Hi Tom,

    This looks really excellent. I am however relatively new to macros / VBA codes so having copy pasted your code in the Developer mode of an Excel file, what are the next steps to use them? Can you please help? Just to recap, I opened a blank Excel workbook, clicked on Developer, copy pasted the comments code and saved the file to the desktop.

    Now how do I go about using it to add comments to an existing file? My apologies for asking a question which may be basic to you great geniuses, but I am not there yet and aspire to get there.

    Many thanks for helping me with next steps that I need to take so that I can now use the code.

    Best Wishes

    Deepak Dave, CMA, MBA, PMP
    Senior Management Consultant

  17. Tom says:

    Dear Dave,

    The best thing to do is to copy the macro in the personal.xls(x) file. The personal excel file will always be launched when you open excel so you can use it with every excelworkbook.
    Read all about it on the page of Microsoft.
    https://support.office.com/en-us/article/Copy-your-macros-to-a-Personal-Macro-Workbook-aa439b90-f836-4381-97f0-6e4c3f5ee566

    Once you have the macro in the personal, you can 'call' the macro by the keyboardcombination 'alt+f8' and klik on the macroname.

    Hope this clarifies the 'how to'. Good luck with your first steps in the wonderfull world of macro's.
    Tom

    • Deepak says:

      Hi Tom,

      Many thanks. I will try that out. Learning is fun and learning this stuff is even more amazing.

      Best Wishes

      Deepak Dave

  18. Gary says:

    There is a line 'Dim LArea As Long' which does not appear to be used. Have I missed something?

  19. Luis says:

    Excellent hack!
    For some reason when I opened my file after using LibreOffice Calc, all comment boxes had changed to some arrow shape.
    So this macro helped me from manually changing more than 5000 comments in a worksheet, or having to install some Excel extension.
    I used it with the following attributes to get back old style comments:

    It helped me from manually changing more than 5000 comments in a worksheet, or having to install some Excel extension.

    .Shape.AutoShapeType = msoShapeRectangle
    .Shape.TextFrame.Characters.Font.Name = "Calibri"
    .Shape.TextFrame.Characters.Font.Size = 10
    .Shape.TextFrame.AutoMargins = True
    .Shape.TextFrame.AutoSize = True

    Thanks a lot!

  20. Mark Blackburn says:

    This was helpful, thank you

  21. loana says:

    I think this is among the most significant
    information for me. And i am glad reading your article.
    But wanna remark on some general things, The site style is great,
    the articles is really great : D. Good job, cheers

  22. Jen says:

    Is there code to add to this that will format a particular part of the comment (i.e. make the last sentence in the comment bold and in italics)?

  23. Phil says:

    This is fantastic!
    How would I add auto-sizing to it?
    I tried adding this:
    .Shape.AutoSize = True but it gives me an error and as a novice at VBA I can't figure it out.

  24. site de promos says:

    Hello I am so glad I found your web site, I really found you by accident,
    while I was browsing on Bing for something else, Nonetheless I am here now and would
    just like to say thanks a lot for a remarkable post and a all round entertaining blog (I also love the theme/design), I don’t have time to
    read it all at the moment but I have book-marked
    it and also added in your RSS feeds, so when I have time I will be back to read a lot more,
    Please do keep up the fantastic work.

  25. E.H. says:

    This is GREAT!

    How should the code be changed in order to tun once for all worksheets in a workbook?

Leave a Reply