Howdy folks. Jeff here. I recently gave a presentation on Excel efficiency to a bunch of analysts, in which – among other things – I’d pointed out that if you ever find yourself having to switch calculation to Manual, there’s probably something wrong with your spreadsheet. Here’s the slide:
This prompted one of the participants to come to me for advise regarding restructuring a spreadsheet with that very problem. This analyst had a file with only 6000 rows of data in it, but the file size was something like 35MB, and after each and every change she had to wait at least a minute for the file to recalculate before she could do something else.
It turns out there were two problems with her files that were easy to resolve.
The Confused range
First, there was a problem with the Used Range – the area within a worksheet that Excel thinks contains all your workings and data. You can find out what this is for each spreadsheet by pushing [Ctrl] + [End], and seeing what cell this takes you to. Hopefully it will take you to the bottom-most, right-most cell that you’ve actually used in the sheet:
But occasionally, you’ll see that it might take you far, far below that cell. Maybe all the way to the very bottom of the grid:
This is bad. Why? Because when Excel saves a file, it includes information about things such as what type of Cell Formatting is used within the used range. If the used range includes millions of cells that aren’t even used, then the information that Excel saves regarding these cells can really blow out the file size. This is exactly what had happened in the case of the spreadsheet concerned. After we reset the used range, the filesize plummeted from 35MB to around 2MB.
Often you can reset the Used Range simply by selecting all the the empty rows under your data, and then deleting them. To do this, select the entire row immediately below your data, then press [Ctrl] + [Down Arrow] to extend the selection right to the bottom of the sheet, then right click and select Delete:
Note that you’ve got to use the Right-Click>DELETE option, NOT the Delete key on the keyboard. Pushing that Delete key does not reset the used range. In fact, this is often why the used range is wrong…it still reflects some data that used to be in the sheet, but that the user subsequently deleted using the keyboard.
When you’ve done this, then push [Ctrl] + [End] again and see where you end up – hopefully at the bottom right corner of your data.
Sometimes this doesn’t fix the problem, and you still find yourself well below your data. In this case, a bit of VBA will usually suffice. I’d suggest putting the below code into your Personal Macro Workbook, for times like this:
Sub ResetUsedRange()
Dim sht As Worksheet
Dim lng As Long
For Each sht In ActiveWorkbook.Worksheets
lng = sht.UsedRange.Rows.Count
Next
End Sub
To see what to do with this code, read What would James Bond have in his Personal Macro Workbook.
Too much SUMIF
The second problem is that each file contained something like 60,000 SUMIF formulas in them. And each one of these formulas referenced two entire columns, rather than just the 2500 rows that actually contained data. It’s really easy to see just how big a problem you might have, simply by doing a Find All for the name of the particular function you’re after:
You can throw 60,000 VLOOKUPS or IF statements or other run-of-the-mill functions at Excel and it won’t even blink. But 60,000 resource-intensive number-crunching functions such as SUMIF, SUMPRODUCT, COUNTIF etc pointed at very large ranges will cause Excel to flinch, if not shut it’s eyes completely for large periods of time.
That’s because these functions are like Ferrari’s…very powerful, but very expensive. One SUMIF is going to travel very fast down the highway. A few hundred SUMIFS on the same stretch are still going to whiz by pretty fast. Tens of thousands of them are just going to crash in to each other:
(The image above comes from this New York Times article detailing a spectacular traffic pileup in Japan in 2011 that left a highway strewn with the smashed wreckage of eight Ferrari’s, a Lamborghini and three Mercedes sports cars. No-one seriously hurt apart from severely injured pride and a marked increase in insurance premiums the following year.)
Often you can use a PivotTable to do the same thing as a whole bunch of functions like SUMIF, COUNTIF, SUMPRODUCT et cetera. PivotTables are natural aggregation and filtering tools. In this case I could use just one PivotTable to replace those 60,000 SUMIFs, and recalculation time dropped from minutes to milliseconds. Now, reporting on this business process is effortless.
One spreadsheet, two morals
I’ve got two morals to share regarding this.
The first is to keep your eyes peeled for signs of trouble in your spreadsheets. Think of FileSize and Recalculation Time as the rev-counter of your car…if it’s getting further and further into the red, then pull over, and check under the hood.
The second – and I can’t underscore this enough – is the importance to organizations of educating all users on how to recognize symptoms of inefficiency. They don’t all have to know how to treat it (although that would be good), but just how to diagnose it. Because if it goes undiagnosed, avoidable inefficiency imposes significant, on-going, and very real opportunity cost. A real dollar amount.
Raising awareness of danger signs is possibly the biggest efficiency gain and risk-reducing opportunity that any training initiative can offer, at the least cost. It’s a game-changer.
Two morals, multiple remedies.
Over at the Daily Dose of Excel blog, I recently posted a mock business case centered around corporate investment in Excel training programme. There’s much more food for thought there, and even more in the comments, so go take a look, and please do leave a comment there with your own thoughts.
While this business case revolves around an internal corporate training programme, another great way of reducing this opportunity cost is through courses such as Chandoo.org’s own Excel School, VBA Classes, and other Chandoo courses.
Not to mention other fantastic courses that you’ll find advertised on the web if you look.
And yet another is though interactions in places like the Chandoo Forum, where you’ll find an army of ninjas with more collective experience than the Borg from Star Trek. The hive mind that is a forum knows no equal.
And of course, you’ll find a wealth of information on this very blog, in articles like I said your spreadsheet is really FAT, not real PHAT!
About the Author.
Jeff Weir – a local of Galactic North up there in Windy Wellington, New Zealand – is more volatile than INDIRECT and more random than RAND. In fact, his state of mind can be pretty much summed up by this:
=NOT(EVEN(PROPER(OR(RIGHT(TODAY())))))
That’s right, pure #VALUE!
Find out more at http:www.heavydutydecisions.co.nz
14 Responses to “How to Add your Macros to QAT or Excel toolbars?”
We have only just got excel 2007 so this is helping me navigate my way through the differences cheers.
For Macro's i always add a Command Button, rename it something obvious, change the colour of it and finally add the following to its View Code section.
Application.Run "MAcro1"
This way anyone opening the file knows what to do if i ever win the lottery and dont make it in 🙂
Hi,
Good article. But I have this problem.
1) Customized QAT with a macro. Macro name = MacroX
2) Runs OK from original location (e.g. C:\TestLoaction1\TestFile.xls)
3) Copy past file to new location (e.g. C:\TestLoaction2\TestFile.xls)
Menu button now fails:
Cannot run the macro "C:\TestLoaction1\TestFile.xls'!MacroX' The macro may not be available in this workbook...
Of course the code is there, and macros are enabled.
Could get it to work after deleting and recreating macro custom buttons. So have to re-assign macro to QAT button every time I move the file?
If I put a form button on he worksheet and assign the macro to that, it's location independent.
Any ideas?
Thanks
@Ron
What you have said is correct
Macros within a worksheet are stored within the worksheet and hence follow it.
Macros referenced by a button in the QAT or elsewhere are locaed in a file and if that file is moved the linkages don't follow.
The easiest way around this is to store all your macros in a location that doesn't move and is in fact reloaded everytime that Excel starts and that is called the Personal.xlsx/b file.
These are refered to several time at Chandoo.org or have a read of
http://www.rondebruin.nl/personal.htm
or
http://office.microsoft.com/en-us/excel-help/deploy-your-excel-macros-from-a-central-file-HA001087296.aspx
In Excel 2003 and prior versions, a button added to the Toolbar maintained a DYNAMIC link to the file (e.g. Personal.xlsb) holding the assigned macro, such that if the file was relocated for any reason (by using Excel's native Save As command rather than just moving it via Windows Explorer), the link between the button and the file was updated.
I expected the same to occur with Excel 2007+, but alas, Microsoft in their infinite wisdom have removed another feature useful to advanced users (just as they did by removing the ability to design your own buttons)!!
So having just done some reorganisation of my files, I now have to remove and recreate every friggin macro button on my QAT (I have lots) - what a pain in the proverbial!!
Hi Hui,
Thanks for the help, that's really useful.
1) The macros I'm adding are for one specific Excel application, so I really wanted the macros to follow the file
2) I didn't want to have to pass other files around too and have users installing those - either Personal.xlsx/b or as an Add-In.
3) I realise now that the QAT additions will appear for other Excel workbooks in which I don't want the macros available.
So, it looks like I need to keep it local, by using a button on the worksheet. Unless you can suggest any way of adding to menus just for a specific workbook.
Thanks again for your help. Great site, so I'll be signing up for the emails.
Ron
I know I'm a little late jumping on this post, but wondering if anyone knows how to add a UDF to the QAT? I've saved my UDF in my personal workbook, but it does not show up in my list when I choose Macros when customizing my QAT. Suggestions? Thanks!!
@Cheryl: UDFs cannot be accessed like Macros. You can use them from other macros or from worksheet cells as formulas...
@David: If you save your macros file and then install it as an add-in then it will be always available for you.
The instructions work great when you are creating a new file, and it is still open. I find that I can't access macros after I've saved a file as an xlam and closed it. When I reopen the xlam, either by browsing to it, or by having it set to open as an addin using Excel Options, the macros are no longer available in the macros list when I go to edit the QAT. Any way around that?
[...] Add this macro as a button to Quick Access Toolbar [...]
I need to create a button that will run a macro. Once you click the button it needs to open up a browser asking you to select a report/file. Once you select the file, it will run the macro on the selected file and then save it as a new report with a name and the current date. I created the macro to sort/modify the report but I do not know how to do what I mentioned above. I hope this makes sense.
I'm having trouble adding a macro to the QAT. I've done everything up to step 5 but my macro isn't showing up. What am I doing wrong?
[...] Add Macros to Quick Access Toolbar (works in Excel 2003 & above) [...]
Hi,
Thank you for the explanation. Very useful for a recent switcher from office 2003 to office 2010.
My follow-up question is: in Excel (or ppt) 2010, can you customize the macro button that you put in the QAT?
In office 2003, once you chose the custom button for your Macro, you could then edit pixel by pixel the said button.
For instance, I've created 2 Macros in PPT that are converting all my slides to either English or French language, so I'd like one button to show EN and the other FR... that would be more meaningful that any of the possible "custom" office 2010 buttons
I read all the post and one important aspect to the QAT was never mentioned. That is, you have a macro driven worksheet that you want to share with other. You have customized the QAT with two icons to run the macros (VBA programs in reality). However, when the others receive the workbook, the icons are no where to be found. It's my understanding those "customized buttons" have been saved to an outside file, Excel.qat. QUESTION: Could one simply attach that file to your email, along with the worksheet, and tell the recipients to copy that file to correct location on their computer - C:\Users\\AppData\Local\Microsoft\Office|\
Would the customize macro buttons then appear in the worksheet and, more importantly, work? Thanks for your thoughtfulness and thanks for well written instructions Chandoo!
MortW