Van Gysel asked in a recent post at Chandoo.org for a way to calculate the costs of running a plantation. The twist is that the costs vary by year, and based on the age of the trees.
The following is a slightly simplified version of the solution I offered:
=SUM(IFERROR(LOOKUP(“Year”&MMULT(N($B$3:B$7>0),TRANSPOSE(COLUMN($B$3:B$7)^0)), $B$11:$I$11, $B12:$I12),0)*B$3:B$7) Ctrl+Shift+Enter
Today I am going to try and explain how the formula works.
As always at Formula Forensics, you can follow along with a sample file: Download Here
The Problem
In a plantation, the costs for planting and maintaining trees vary based on the age of the trees and by year. The table below shows the acres of trees planted per year and the yield and costs per year that vary based on the age of the trees.
Let us look at the calculations needed for each year.
Year 2013
- 300 acres of trees were planted in 2013. Calculations for 2013 are as follows. (Only Yield calculation is shown, but the process is similar for Nursery costs, Fertilizers, etc.)
- The trees do not yield any fruits in the first year. As such, Yield for year1=300*0=0
That was easy!
Year 2014
- 700 additional acres of trees will be planted in 2014. Calculations for 2014 are as follows. (Again, only Yield calculation is shown, but others are calculated similarly.)
- 300 acres of trees are 2 years old. 700 acres are 1 year old.
- The 300 acres from 2013 now yield fruit since it is year2. However, the new trees (700 acres) do not yield any fruits yet. So total yield for 2014=300*Year2Yield+700*Year1Yield=300*5+700*0
Year 2015
- 1000 additional acres are to be planted in 2015. Calculations for 2015 are as follows:
- 300 acres are from 2013 (3 years old); 700 acres are from 2014 (2 years old); 1000 acres are from 2015 (1 year old).
- Yield for 2015=300*Year3Yield + 700*Year2Yield + 1000*Year1Yield = 300*10 + 700*5 + 1000*0
Year 2016
- 1000 additional acres are to be planted in 2016. Calculations for 2016 are as follows:
- Yield for 2016=300*15+700*10+1000*5+1000*0
How do we simulate the above calculation in an Excel formula?
A Solution
Let us first look at how we performed the calculations above manually, using the 2016 Yield as an example.
- We took each acreage value in 2016, and determined its age by counting how many years it has been since that acreage was planted. You might have observed that the age can be counted by the number of times a value has been repeated up to that point. (In other words, if I planted 300 acres in 2013, I should see that same amount in 2014, 2015 and 2016.) As such, 300 acres is repeated 4 times. 700 acres is repeated 3 times. 1000 acres is repeated 2 times. And the latest planting of 1000 acres exists only once.
- Once we determine the age for a given acreage, we looked up the yield for that age in the second table
- We then multiplied the acreage with the corresponding yield value.
Calculation #1 can be expressed as follows:
- Age for acreage 1 (first planted in 2013)=count of B3:E3 where value is greater than zero. i.e. COUNTIF(B3:E3,”>0”)
- Age for acreage 2 (planted in 2014)=count of B4:E4 where value is greater than zero. i.e. COUNTIF(B4:E4,”>0”)
- Age for acreage 3 (planted in 2015)=count of B5:E5 where value is greater than zero. i.e. COUNTIF(B5:E5,”>0”)
- Age for acreage 4 (planted in 2016)=count of B6:E6 where value is greater than zero. i.e. COUNTIF(B6:E6,”>0”)
- Age for acreage 5 is zero since nothing has been planted for 2017 yet in 2016
The above approach would work if we were calculating the age one row at a time. However, that can become tedious really fast. We need to perform the calculation for the full range (B3:E7) together, but return the counts for each row individually.
Excel’s MMULT function comes to the rescue!
MMULT (which stands for Matrix Multiply) multiplies two matrices and returns a third matrix based on rules for matrix multiplication. I am planning to devote a whole article to explain the MMULT function. As such, for this article, we will summarize the utility of the function as “take a 2-dimensional array, add each column’s value for each row, and return a 1-column array”.
MMULT requires that its arguments be numeric.
So to obtain the counts for the year 2016, we can use the following:
MMULT(N($B$3:E$7>0),TRANSPOSE(COLUMN($B$3:E$7)^0))
As you can see from the picture below, MMULT’s results are the addition of each column for each row.
In the above formula, you may have noticed that the range uses absolute and relative referencing (signified by the $ sign or lack thereof). This is to ensure that the range grows or shrinks as needed. The upper left address is held constant ($B$3). However, the lower right address for the range has columns that vary but row that is fixed on row #7. This ensures that the formula would work if we copy to the left, right, etc. in the final results.
Now that we have the age for each acreage value, we can look up the corresponding yield value using (what else?) LOOKUP function.
But before we can use LOOKUP, we will need to convert the numeric values returned from MMULT into the strings Year1, Year2, etc. found in the Costs table. Of course, you know how to do that… concatenate the string “Year” to the result from MMULT
“Year”&MMULT(N($B$3:E$7>0),TRANSPOSE(COLUMN($B$3:E$7)^0))
For the 2016 example, we get {“Year4″;”Year3″;”Year2″;”Year1″;”Year0”}
We can now use LOOKUP as follows:
LOOKUP(“Year”&MMULT(N($B$3:E$7>0),TRANSPOSE(COLUMN($B$3:E$7)^0)), $B$11:$I$11, $B12:$I12)
You may recall that LOOKUP looks up a value in the array indicated by the second argument, and returns the corresponding value from the third array argument. In this case, instead of looking up a single value, we look up an array of values (supplied in the first argument) to the function.
The above formula translates to the following:
LOOKUP({“Year4″;”Year3″;”Year2″;”Year1″;”Year0”}, {“Year1″,”Year2″,”Year3″,”Year4″,”Year5″,”Year6″,”Year7″,”Year8”}, {0,5,10,15,20,25,30,35})
The result from LOOKUP is {15;10;5;0;#N/A}
(The last value is #N/A because there is no acreage value for 2017 yet (as of 2016 column). The concatenation resulted in Year0 which does not exist in the “Age of The Trees” range (B11:I11) above.)
By using IFERROR(LOOKUP(…),0) we get {15;10;5;0;0}
We can now multiply the above result with the acreage values for 2016 to get {4500;7000;5000;0;0}
Finally, we SUM the values to get 16500
Putting it all together, we get the following formula (shown for Production for year 2016)
=SUM(IFERROR(LOOKUP(“Year”&MMULT(N($B$3:E$7>0),TRANSPOSE(COLUMN($B$3:E$7)^0)), $B$11:$I$11, $B12:$I12),0)*E$3:E$7)
One of the benefits of the above formula is that you can copy the same formula to calculate values for additional years, as well as other plantation costs.
Download
You can download a copy of the above file and follow along: Download sample file.
Let me know (using the comments below) what you think of the above approach and solution, as well as any other approaches you have utilized to solve a similar problem. In the meantime, I wish you continued Excellence!
-Sajan.
Other Posts in this Series
The Formula Forensics Series contains a wealth of useful solutions and information.
Visit the Formula Forensics Home Page to read other articles in this series.
20 Responses to “Untrimmable Spaces – Excel Formula”
Hi Chandoo,
First of all, HAPPY NEW YEAR!!! Wish you and your family another fruitful year ahead.
To answer your question: Power Query is the best way to trim. 🙂
Btw, if Power Query is not available, then formula would absolutely do... but did you forget to mention also Char 32?
One more question: Is the trailing minus meant to be a negative number? Maybe only the sender knows... 🙂
Cheers,
I just see your PQ way, it is amazing, I think it is the most simple way.
No idea how it did it?
I know these spaces can be a real pain but these days I advise Excel users to learn and use Flash Fill and that will learn what to do pretty quickly.
Highlight range to be cleaned. Then, in Replace, hold down the Alt key and type 0160. Replace with nothing.
I accomplished this by writing a macro to go through all the possible unprintable characters. Looped through the range.
@Steve
Brute force works just as well, its just slower
I use a different method here. First, I will copy the data from Excel and paste it in a notepad. In Notepad, I will do a Find Blanks (Space " ") and Replace (Empty) with nothing.
Then you can copy the data from Notepad and paste it back to Excel which will be a perfect number as you desire.
But Thanks for the formula. Its probably the 2nd out of 8 tricks as Chandoo mentioned. Waiting for the rest among 8 from other users 🙂
Hi....
You don't always need notepad for that. I use the Find/Replace is Excel works just fine.
I don't understand the x's. Why weren't they removed in the formula? Or are they part of some sort of numeric formatting that I'm not familiar with? I saw how you handled the non-breaking spaces and the dashes, but am confused about what role the x's played in all this.
Thanks!
Hi Andrew ,
The xs have been used solely to demarcate the actual data text ; thus , without the x in place at the end of text , as in :
x 4,124,500.00 x
it would be impossible to know that there are unwanted trailing characters , in this case , after the last 0.
These xs are not part of the original data text , nor are they used in the formulae ; they are put in only so that readers can visualize the individual items of data as they are in practice. Think of them as imaginary delimiters.
Oh, that makes sense! Thank you for the explanation. I had a feeling it was something along those lines.
You can type this character using the Keys Alt+0160.
Very useful to replace this Character using Find and Select resource.
For many years, my jobs have included ETL tasks and I built this macro to help long, long ago. I tweak it every now and again. Many co-workers, past and present, have it wired to a button on their toolbar.
Sub Clean_and_Trim()
'CAUTION: Strips leading zeroes -- do not use on zipcodes, etc.
If Application.Calculation = xlCalculationAutomatic Then
Application.Calculation = xlCalculationManual
Revert = 1
ElseIf Application.Calculation = xlCalculationManual Then
Revert = 0
End If
For Each Cell In Selection
For x = Len(Cell.Value) To 1 Step -1
If Asc(Mid(Cell.Value, x, 1)) = 160 Then
Cell.Replace What:=Chr(160), Replacement:=" ", LookAt:=xlPart, MatchCase:=True
End If
If Asc(Mid(Cell.Value, x, 1)) = 32 Then
Cell.Replace What:=Chr(32), Replacement:=" ", LookAt:=xlPart, MatchCase:=True
End If
Next x
If Cell.Value "" Then
Cell.Value = Application.Clean(Application.Trim(Cell.Value))
End If
Next
If Revert = 1 Then
Application.Calculation = xlCalculationAutomatic
ElseIf Revert = 0 Then
Application.Calculation = xlCalculationManual
End If
End Sub
This is awesome! What if you have several characters you need to have removed? What would be the easiest way as I can imagine there are several ways.?
# - 35
$ - 36
- 62
/ - 47
, - 44
. - 46
" - 34
: - 58
This is typical case of a Fitbit data export to Csv file. Each number has CHAR160 as thousand separator.. how smart Fitbit, thank you 😉
By the way, i prefer to copy the character, and use find and replace.
Sometimes it happens if you copy a table from outlook and paste it in excel. When you apply formula on those cells you will get error. What i use to do is
copy one character that looks like space,
select the entire range,
go to Find and replace,
Paste the copied character in Find option
Leave the replace option unfilled..
click on replace all..
All the errors shall be converted in to proper values..
Process looks lengthier.. but it is one of the simplest method
If Clean, Trim, and Substitute, or Find and Replace does not complete the job, I usually enter a value of 1 in an empty cell. Copy the Value of 1, Highlight the range of text numbers, and Paste Special, Values, Multiply. This site is great!
You can use Dose for Excel Add-In that can quickly clean huge data with one click besides more than +100 new functions and features to add to your Excel to save time and effort.
https://www.zbrainsoft.com
Hi,
I have a problem in excel. The sheet attached herewith.
TABLE CONFIG 2/6
A B C D E F G H
1 WEIGHT1 43,599 WEIGH2 62500 WEIGHT3 77000 WEIGHT4 66,500
2 DEDUCTION1 15,000 DEDUCTION1 15,000 TEMP 0 DEDUCTION2 11,005
3 RESULT 58,599 RESULT-1 77,500 RESULT-2 77,000 RESULT-3 77,505
4 RESULT SUBSTRACT 0 0 0
5 REQUIRED VALUE 77,500 77,000 77,505
Note: 1- RESULT (58599) IS TO BE DEDUCTION EITHER FROM D4 OR F4 OR H4 WHICHEVER IS MOST
LEAST CELL AMONG RESULT-1 OR RESULT-2 OR RESULT 3.
2-HENCE, RESULT VALUE $B$3 IS TO BE PRESENTED ON CELL EITHER D4 OR F4 OR H4 WHICHER IS
MOST LEAST VALUE
3-FORMULA =IF(E8<H8,$B$9,IF(E8<J8,$B$9,IF(H8<J8,$B$9,IF(H8<E8,$B$9,IF(J8<H8,$B$9))))))
CREATED ON CELL D4,F4 & H4 DID NOT WORK.
PLS FOR YOUR HELP.
THANK YOU
@R
Why not ask the question in the Chandoo.org Forums
https://chandoo.org/forum/
You can attach a file there