Excel formulas acting slow? Today lets talk about optimizing & speeding up Excel formulas. Use these tips & ideas to super-charge your sluggish workbook. Use the best practices & formula guidelines described in this post to optimize your complex worksheet models & make them faster.
10 Tips to Optimize & Speed up Excel Formulas
1. Use tables to hold the data
Starting Excel 2007 you can keep all the related data in a table. For example call center data in our recent dashboard is kept in a table. Tables can be used in formulas with structural references, can be used as a source for pivot tables etc. And since tables grow & shrink as you add / remove data, none of your formulas need to be dynamic. As an example, if you have table called cs, then the formula sum(cs[column_name]) refers to sum of all values in the column_name of table cs. Even if you add more data to CS, the formula still works.
Resources to learn about Excel Tables:
- Introduction to Excel Tables – what are they and how to use them?
- Example: Customer Service Dashboard – Data & Calculations
2. Use named ranges, named formulas
By using names and named formulas, you can simplify your spreadsheet. Not only that, since named ranges & named formulas can hold arrays (ie lists of values), you can hold intermediate results or values that you need to refer many times in these named formulas. This will reduce the formula overhead and makes your workbooks faster.
Resources to learn about named ranges & named formulas:
- Excel School Program: In this comprehensive course, I talk about how to think about and write better formulas for data analysis work.
- Musings on Live Calendar [Excel Hero]
- Examples of Named Formulas – 2023 Calendar in Excel
3. Use Dynamic Arrays & Spill Ranges
Introduced in Excel 365, Dynamic Arrays allow us to build complex calculations with ease. I suggest incorporating new functions like:
- FILTER to fetch a list of values that meet one or more criteria.
- SORT to sort the values
- UNIQUE to eliminate duplicate values on the fly
- XLOOKUP to perform various lookups
- VSTACK / HSTACK to combine datasets
- TOCOL / TOROW to convert tables of data to single row or column formats
- # or Spill operator to manage spill ranges
Learn more about Dynamic Array functions here:
- Dynamic Array Functions – A deep introduction
- Dynamic Array Functions – how to use them [Video]
- How to use XLOOKUP
4. Use Pivot Tables
Many times, even when we do not need formulas we use them, because we can. Pivot tables are an excellent way to calculate a lot of summary values with few clicks. Once the pivot is built, you can refer to the pivot values with GETPIVOTDATA or simple cell references. This will reduce a lot of unnecessary calculations. If you are changing the data, you can just go to DATA ribbon and refresh all pivots in one go. This process works smoothly when you use tables to hold the data.
One of the reasons for slow workbooks is lot of data. Since, pivot tables are designed to work with lots of data, by using them, you can speed up your workbooks.
Resources to learn Pivot Tables:
5. Sort your data
One of the reasons for sluggish performance is that you are searching for something in a lot of un-sorted data. You are making Excel look for a needle in a hay-stack. Many times we inherit un-sorted data thru data imports. By sorting the data & using correct operators in lookup formulas, we can instantly speedup a sluggish workbook. If you feel that sorting the data is a pain, you can even automate it with Power Query or a sort procedure (thru a simple VBA macro).
Examples on Sorting:
- Remove duplicates & sort a list using Pivot Tables
- Use Power Query to pre-sort the data you are working with
6. Use Manual Calculation Mode
Speed is the hefty price you pay for complexity. But many times, we want our Excel workbooks to be complex, because only then they would reflect real world. In such cases, you can set formula calculations to manual mode.
Just press F9 whenever you want to run the formulas. Please note that Excel runs formulas whenever you save the file too.
7. Use Non-volatile formulas
There are a class of formulas in excel called as volatile formulas. These formulas are re-calculated whenever there is a change in the workbook. Examples of volatile formulas are RAND, NOW, TODAY, OFFSET etc. So when your worksheet has a lot of volatile formulas, any time you make a change all these formulas must be re-calculated. Thus, your worksheet becomes slow.
Solution? Simple, do not use volatile formulas. For example, instead of using OFFSET to construct a dynamic range, you can use INDEX. Since INDEX is non-volatile, it tends to be faster. Or better still, use a table.
Resources to learn more:
8. Keep formulas in a separate sheet
Formulas are the driving force behind any Excel workbook or model. By keeping all them in a separate worksheet(s), you minimize the chance of mistakes, omissions or repetitions. Debugging or investigating slow performance becomes an easy task when all formulas are in same place. I usually keep all the formulas in one sheet whenever I am designing a dashboard or complex workbook. This structure also helps me in thinking thru various calculations and planning the formulas in a structured way.
9. Write better formulas
Here are some guidelines that I follow when writing formulas.
- Built-in formulas tend to better than your own version – for example SUMIFS is easier to write and just as fast as SUMPRODUCT.
- Do not refer to entire column when you need just a few values. Do not write SUM(A:A), when you know values are only in A1:A10.
- IFERROR instead of lengthy IF(ISERROR formulas. Use IFERROR to simplify your error checking.
- Remove or Fix formula errors [how to, findout why formulas are not working]
- Use newer Dynamic Array formulas instead of old clunky array formulas
- Remove or Reduce references to other workbooks. Use Power Query instead.
- Remove any named ranges that result in error or missing links.
- Try to come up with alternative formulas: this not only sharpens your mind, but lets you discover better solutions.
- Do not calculate something if you do not need it.
- Do not calculate same thing twice. Use the first result second time too. Use LET for accomplishing this.
Resources to write better formulas:
- Introduction to SUMIFS formula
- Introduction to XLOOKUP formula
- How to use the new Dynamic Array functions in Excel
- Introduction to SUMPRODUCT formula
- Introduction to IFERROR formula
- Excel Formula Forensics
- Excel School program
10. Desperate times need desperate measures
Sometimes, no matter what you do, the workbook remains slow. Here are a few whacky ideas that I try in such cases:
- Replace formulas with values. I take a backup of the formulas. Then I select everything, CTRL+C, ALT+ESV (or CTRL Shift V). Done!
- Develop the workbook from scratch: Sometimes it helps to design the workbook afresh.
- Replace external data links with actual data: And import data by copy-pasting if needed.
- Reduce the functionality: See if the end user can live with fewer features in the workbook.
- Find an alternative solution: Trying to do everything in Excel is foolish. See if there is any external tool that can do this better & faster.
BONUS: Learn new formulas & play with them
Optimization is not a one-shot exercise. It is an ongoing-business. So you need to constantly learn new formulas, new uses & play with them. This way, you see new ways to improve a sluggish workbook. To begin with, explore our Formula homework & formula forensics pages and see how you solve these problems.
How do you speed-up your Excel formulas?
So how do you optimize & speed-up your Excel formulas? What techniques do you use? Please share using comments.
42 Responses to “Prevent Duplicate Data Entry using Cell Validations”
Hi Chandoo, I need you help in the following problem.
I'm trying to get a direccion from a found result. With this dirreccion I will want the before cell value. For example, If result of a find is 38 localized in cell $C$2, I need to get previus value (cell $B$2 ), maybe Andrés.
Do you know some way to do that?
Thank you for you help.
Hi Chandoo
Thanks for this. One thing though: In my pre-2007 version of Excel, the COUNTIF function doesn't recognise a semicolon (;), but requires a comma.
Is the semicolon an Excel 2007 thing?
Jair... I am not sure I understand what you want. what do you mean by Dirreccion?
@Lincoln: I am sorry, often I forget that I am using European version of excel where the delimiter is ; instead of ,. I have corrected the formula now.
Thanks for this nice tip, i used to do a find all after filling every new items which was cumbersome.
Do you know a way to extend this validation search to other tabs/sheets ?
Thanks for you attention. I'm trying to get of value continue from a found value. Let me show a example:
Name Years
John 35
Maria 28
Teresa 32
If I search the max years, the result is 35, but I need that result to be John. Do you know how I can do it?
@Subbu.. you can easily extend the validation to other sheets by pasting the data validations. See the latest article here: http://chandoo.org/wp/2009/10/28/copy-data-validations/
@Jair.. you can use the large() or small() formulas to do this. for eg. =index(A1:A3,large(B1:B3,1)) will get you the name of the person with highest "years". More help here: http://chandoo.org/excel-formulas/large.html
Hi, I don't know if I'm using bad the formula or its performance is diferent for my Office version. Large() formula return the value in the cell, in my example 35. The index() formula use a range, row and column. I'm using the large() as number of row, and it is bad because into the range don't have row 35. This is my perception. What do you think?
Hi, I going to prove, with this solution by JLD http://jldexcelsp.blogspot.com/2008/07/extraer-direccion-de-celda-en-matriz.html
Hello,
I am trying to attempt data validation in Excel Mobile, but the DV tool isnt available. I want to prevent duplicates is all, any advice on acheiving this in Excel Mobile? Thanks..
@Jair... my french aint that good. it starts at "merci" and ends at "beau coup".
Anyhow, you need to merge the large with vlookup to do this. I am not sure if you have solved the problem. Otherwise let me know with details and I can write the formula in comments.
@Chad... I have never used excel mobile, so I have no idea. May be they have not implemented data validations in excel mobile.
Any excel mobile users out there?
Hi Chandoo, the proposed solution by JlD is interesting. He created a macro to get values when the matrix is not one dimensional, how on my problem. This fuction for me.
I would like to share you my work, how can I upload?
@Jair.. sorry for such a delayed reply.. you can upload the files to skydrive and link them here. Or you can email them to me at chandoo.d @ gmail.com and I will upload them somewhere. But it could take forever if you email files to me as I am a bit lazy.
[...] Day 31: Advanced Data Validation Tricks in Excel – Part 2 [...]
Hi,
Can you help me in Microstrategy?
Br,
Moin
really wonderful article. I feel it is implementing Primary Key concept into spreadsheets.
Hi article on data validation. Excel is a very versatile platform to work with and we use it for all kinds of data tabulation. In fact this must have been the most rudimentary data management tools I must have worked with and knowing such tips only adds functuionality to our user experience. Great article. looking forawrd to read more.
Hi Chandoo,
Thanks for such a nice idea.
I tried copy paste the data into the validated area, but the pop-up msg (warning msg) doesn't came. Is it something that we need to update the data manually each time,.
Do we have any option where we can bulk upload the number and it throws a warning message that the data already exits and do we want to continue with this ?
Please do reply me.
Thank you.
Regards,
Vasanth.
It was really useful chandoo...thanks a lot...
Tried this in excel 2010 and it did not work?
Could the newer excel have changed that much?
@Leo
It works fine in Excel 2010
The formula used above =COUNTIF($B$4:$B$11,B4)<=1
only applies to the range B4:B11
Did you adjust the range to your data?
This page helped me accurately to find solution of my question. thanx
we want to prevent duplicate entries in three columns combined, using data validation, i.e. say, column A has first name and Column B has middle name, Column C has last name. the first name can be duplicate, middle name can be duplicate, last name can be duplicate, but not all three at the same time.
I want to prevent duplicate entries in three columns combine, using data validation, i.e. say, column A has first name and Column B has middle name, Column C has last name. the first name can be duplicate, middle name can be duplicate, last name can be duplicate, but not all three at the same time.
Hi, I've tried above validation method to prevent duplicate value from entering into the cells. It's work, when user key in the data into the selected range. However, it's not working when user copy-&-paste the info into the same range.
Please advice. Thanks.
Hi Chandoo,
Does it work in Excel 2007?
Please Reply
thanks chandoo........
it does not work when data is copy pasted...any solution for this??
hi i m shaloo and i want to know in excel if i write duplicate no.then it says or show about we are write duplicate no.
Hi Chandoo
I've tried using this with a Named Range, which is actually a column in a Table as DV wont accept a table reference, and it wont work.
Also tried using Offset to specify the Named Range, but that wont work either.
Is it possible to use Named Ranges with DV?
Thanks
Kris
I have tried the above formula on a table column. The Error box does not pop up, there is only the small ! next to the cell with the duplicate. The column I am working with is formulas that produce a date. Is the reason it doesn't work that the cells contain formulas rather than data?
The formula works but only if I enter data in cell above it. So for example, if I have "123" in B11 it does not allow me to enter "123" in B10, B9, B8, etc. But I can still enter "123" in B12. Please help! 🙂
Great tip.. thanks a lot
I have 21 years of experience working as data entry assistant. I constantly read several blogs to keep myself up-to-date with the advances in data entry profession. I really enjoyed this blog post. From my several years of experience, I agree with you 100% when you say, “ We all know that data validation is a very useful feature in Excel. You can use data validation to create a drop-down list in a cell and limit the values user can enter. ”
Keep blogging. I will come here again.
--data entry assistant
Hi,
This is really very helpful.
Thank you
how can i assign two validation on a single cell
one is for list validation (means the data should be from that range)
second i want to prevent them from repetition
how can i do this ?
P7 to P506 have GR# which are for list
i want to prevent C column to not to repeat and should be from the P column
@Junaid
Can you please post the question in the Chandoo.org Forums
http://forum.chandoo.org/
You have to register to be able to post questions
Please attach a file so that a specific answer can be delivered.
i made an account but there is no option available to post questions ??
where can i ??
@Jubaid
Goto http://forum.chandoo.org/
Goto Ask an Excel Question
Post New thread
Type your question
Attach a file
Please attach a file so that a specific answer can be delivered.
friend can any one tell me the formula
exname location qty
gaurav 1 1
rofan 2 5
sandeep 3 6
gaurav 4 3
rofan 5 4
sandeep 6 8
gaurav 7 9
If this is a data.
if i want a formula by which if i type gaurav then all the location and qty should be shown in a new page.
i had 5,00,000 sku so if i punch one name i can get the entire details
@Gaurav
Can you please post the question at the Chandoo.org Forums
http://forum.chandoo.org/
Please attach a sample file for a quicker more targeted response
IF(ISERROR(INDEX($B$3:$C$9,SMALL(IF($B$3:$B$9=$B$12,ROW($B$3:$B$9)-ROW($C$2)),ROW(A1:C1)),2)),"",INDEX($B$3:$C$9,SMALL(IF($B$3:$B$9=$B$12,ROW($B$3:$B$9)-ROW($C$2)),ROW(A1:C1)),2))
please explain
YOUR COUNTIF FORMULA IS REALLY HELPFUL AND WORKS. I TRIED SEVERAL SITES BUT THEIR FORMULA DOES NOT WORK. ONLY YOU HAVE GIVEN A RIGHT FORMULA!
THANK YOU!!!!!