Are You Trendy ? (Part 3)

Share

Facebook
Twitter
LinkedIn

So you’ve made it to part 3 of Are You Trendy, well done.

In todays final post of Are You Trendy? we will take a break from the maths and discuss techniques and tools that Excel provides to assist us with Trend Analysis.

We will look at 2 techniques, one built-in to Excel called Charts and another which is a User Defined Function (UDF) I developed.

Both techniques have uses in analysis of trends.

Once again all examples below are found on the Examples Workbook.

Excel Charts

Excel has a number of charting styles some of which have the ability to calculate and display Trend Lines.

The following tables shows which charts Do and Don’t support built-in trendlines.

Supports Trendlines Doesn’t Support Trendlines
Scatter (X Y) Pie
Line Donut
Area Radar
Column Stock
Bar Surface
Bubble

For those charts that don’t support trendlines, this doesn’t stop us, as Excel users, from adding other series or using other techniques to add trendlines to the charts, it just that we have to do the hard work ourselves and not use Excels built-in skills.

For this exercise we will be using a Scatter (X Y) Chart but the techniques apply equally to all charts that support trendlines.

So lets go: First we need some data.

Next add a scatter chart , Select the data and Insert Chart, X Y (Scatter Chart)

Adding a Trend Line to the chart is as simple as selecting the chart and right click on the Series you want to add the Trend Line to, see below.

You can change the trendlines properties to make it stand out as per the above.

Once you add a Trendline a Format Trendline dialog will appear.

This is the main window for setting Trendline properties and format options.

In this post I am not going to be dealing with the Tab Options of Line Color, Line Style, Shadow and Glow and Soft Edge options, as I am sure you can work out what they do and play with them at your leisure.

Trendline Properties

Once you have added a Trendline you can access the Trendlines properties at any time by:

Selecting the chart

Select the Trendline

Right Click and Format Trendline.

How Many Trendlines Can I Have ?

You can add a large number of Trendlines to each Chart Series in Excel by simply selecting the Right Clicking on the Chart Series and select Add Trendline.

Some of the regression types may not be available on second and subsequent regressions.

Trend/Regression Type

The main section of the Format Trendline dialog is the Trend/Regression Type:

This section lists 5 trend types we are familiar with from the Are You Trendy? (Part 2).

For more details on the individual Tren Types refer to Are You Trendy (Part 2).

The default trend type is Linear ( Y = mX + c ).

You can select each type in turn and see the estimated trend.

Exponential

Linear

Logarithmic

Polynomial

This shows the Trendline for a Polynomial Estimate of Power = 2. Excel supports up to Power = 6.

Power

Moving Average

Moving average isn’t a forecasting tool, but is more of a data manipulation tool, which is commonly used for elimination of short term trends or smoothing of the data source. Some industries use Moving Averages to look at buying and selling opportunities by comparing the current price against longer term trends.

It is possible to use moving average data for trend analysis, but this must be first done manually in Excel and then it can be used with the techniques discussed here.

As such we won’t be discussing its use here.

If you are interested in reading more about the use of moving averages have a look at  Moving Average.

Trendline Name

The Trendline Name section by default shows you the Selected Trend Estimation type and your Data Series Name eg: Linear (My Data)

However you can type whatever Name you want by using the custom field:

eg: Huis Fruit Shop Sales Trend

Forecast

The Excel Chart Trendline function allows us the option to project our Trendline a number of periods or X Values into the future or past.

The above will forecast our trend line 50 X axis values past the limits of our data and 10  X axis values prior to the limits of our data and is shown below.

This is a great option to use for 2 reasons.

Firstly you can use this to see where the Trendline will cross the Y axis (X = 0) and is an important check to validate your selected Trendline.

You can see in the example above that the Trendline crosses the axis at -10. If this isn’t correct we can either try another estimation technique or Excel has a tool, which is discussed below, to deal with that.

Secondly, you can use it to look into the future by projecting the Trendline past your data limits.

Misc Parameters

The final 3 parameters

Set Intercept

By default Excel Chart Trendline has used a Const value of True and hence calculates the natural intercept value for the data. If you want to over-ride this with a 0 intercept value Tick the box and select a value

Set Intercept : Not selected

Set Intercept : Selected Value of 10.0

I would always suggest using the Forecast backwards option first to see what the natural intercept is before using this option (Both charts above show the Trendline projected back 10 periods) but the second chart has a Y intercept set manually to 10.

Display Equation on Chart

The Display Equation on Chart options use is self explanatory, it Display the equation to the current Trendline on the current Chart:

The equation is based on the select Trend type.

The equation is also live, in that if you change and selected another Trend Type or the data changes the equation will update, similarly if you select to intercept the Y axis at 0 or another value.

By selecting the Text Box which has the equation the equations Font properties can be changed eg: Font Style, Size, Italic, Bold etc as well as background color.

Display R2 on Chart

This display the R2 value on the chart in the equation Text Box as shown above.

The R2 value is based on the select Trend type.

The R2 value is also live, in that if you change and selected another Trend Type or the data changes the R2 will update, similarly if you select to intercept the Y axis at 0 or another value.

By selecting the Text Box which has the equation the R2 the Font properties can be changed eg: Font Style, Size, Italic, Bold etc as well as background color.

How Can We Look at Values Along a Trend Line?

In Are You Trendy? (Part 2) and in the section above we looked at a number of ways of establishing a Trendline.

So how can I predict values along a Trendline?

There are a few ways and we will discuss 2 of them.

1.       Write an equation in excel

2.       Use my Trendy User Defined function.

Write an Equation in Excel

In the previous section we had a chart shown below:

The equation for the line of best fit is Y=7.8984.e^(0.0256.X) which in Excel cell formula talk is =7.8984*EXP(0.0256*X Cell)

So we can setup a cell or range of cells in excel to show us either intermediate values or future values of X and the corresponding Y values.

The great thing about having an equation is that we can now use this to animate our chart.

I’m not talking about Avatar style animation, but simply adding a tool for the user to interactively select X values and the equation and chart will show us the new Y value. This even allows us to show future values past the end of our data because we are using the equation to our data.

How do we do this?

Refer to Sample Workbook.

Firstly lets add a cell which will contain the X value

E52 = 10

Secondly add a cell which has our equation

E53:  =7.8984*EXP(0.0256*X Cell)

Third add a Scroll Bar Control from the Active X controls on the Developer toolbar and set a few properties

Minimum = 0

Maximum = 300

Linked Cell = E52

Large Change = 10

Fourth add a new series to our chart which will just have a single X and Y value

Series Name = “Our Trend”

X Series = E52

Y Series = E53

You can now interactively move the srcoll bar back and forth and the Chart will show you the new forecast value for our sales in Huis Fruit Shop.

The limitations with the above approach is that it is fixed to the equation you use for your Y value, which is based on your selected choice of Trendline type.

Can we link this technique to the equation from the Trendline ?

With Excel natively, No 🙁 .

TrendY – A User Defined Function for the Analysis of Past, Intermediate & Future Trendline Values

In a post at Chandoo.org user Trevian3969 asked the question “How can I view intermediate values along a Charts trend line?”

The answer was the development of the UDF, TrendY (Trendy).

Trendy was developed to do exactly that, take the equation from a Charts Trendline and evaluate it to determine intermediate, past or future values based on a given X input.

Because the UDF is taking the equation for the trend line it can be used to return a Y value for any X values, prior to, later than or within the supplied or known X Range of the chart.

An Example of the use of Trendy is shown in the attached Workbook

Form:   = TrendY(X Value, [Chart No], [Series No], [Trendline No])

X Value: Is the X Value that you want to know the Y Value of the Trendline

Chart No: Chart No is optional and is the Chart No on the current sheet, Default or omitted = 1

Series No: Series No is optional and is the Series No on the chart, Default or omitted = 1. The series No is the number shown at the end of the Formula Bar when a series is selected

eg: =SERIES(“My Data”,Sheet1!$B$2:$B$41,Sheet1!$C$2:$C$41,1)

Trendline No: Trendline No is optional and is the Trendline No of the Trendline you wish to track. Default or omitted = 1.

[Option Parameters, Default = 1]

Eg:    = TrendY(20)  will place the value of X=20 into the Trendline Equation of the Trendline of Chart 1 Series 1 Trendline 1

= TrendY(40,1,3,2)  will place the value of X=20 into the Trendline Equation of the Trendline of Chart 1 Series 3 Trendline 2

=TrendY(B43,,3) will place the value of cell B43 into the Trendline Equation of the Trendline of Chart 1 Series 3 Trendline 1. Chart and Trendline both default to 1 as they are omitted.

The function works with all the Trendline types and variants of those, except the Moving Average.

To use the Trendy UDF copy the following code to a VBA Module or alternatively import the Txt File as a new Module

Trendy Code Module

The code is also available in the Example Workbook with a fully working m0del.

If you don’t have the Trendlines equation shown it will do that for you and it ignores the R^2 function if shown.

The Trendlines equation box is actually where the function gets the equation from in the first place.

Then on a worksheet simply use then =Trendy(X Value) as described above.

Trendy has only been tested on Excel 2007 and 2010, use on other versions at your own risk.

Limitations

The Trendy UDF is limited to use the available precision of the parameters, for each equation, as displayed in the Equation Text Box on the Chart.

In some cases especially when multiplying by powers of large numbers and especially in the Polynomial equations, there may be a large discrepancy between the calculated value by Trendy and the displayed value by the Trendline on the Chart. In these cases the Trendline is correct. This will show on the chart as the Plot Y value of Trendy not being on the Excel calculated Trendline.

Trendy has 2 constants at the top of the UDF that are used for the calculation of Intermediate Equations. These are equations that the user doesn’t see but are done at a much higher level of precision to avoid these errors. These constants are:

Const DataLabelNoFormat = “#,##0.0000”
Const PolynomialNoFormat = “#,##0.000000000000”

If you have rounding errors the easiest way to fix them is to increase the number of decimals by increasing the number of zeroes after the decimal in the appropriate line, remembering that Excel only carries 15 decimal places anyway and Trendy is already using 12 for Polynomial Trends already.

Trendy returns the displayed equations to 4 decimals after the intermediate calculations in any case.

Further Readings

Are You Trendy (Part 1)

Are You Trendy (Part 2)

All Examples from the Are You Trendy? Series in one Workbook

Final

I hope you have enjoyed this 3 part series on Trend Analysis and Forecasting using Excel.

It has been put together to Introduce you to, and whet your appetite to, some of the functions, tools and techniques that you may not have had a lot of exposure to in the area of Trend Analysis and Forecasting using Excel.

I’d like to thank Chandoo for the opportunity to look after Chandoo.org for the past week and the opportunity to put the 4 posts up.

I will now hand Chandoo back the keys to the blog, hopefully without any dents.

Let me know what you thought of the series in the comments below:

Keep us informed on How you go with real data once you start applying some of these techniques.

Hui…

ps: I still don’t know if Trevian3969 was happy with my response to his post as he never responded ?

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

20 Responses to “Untrimmable Spaces – Excel Formula”

  1. MF says:

    Hi Chandoo,
    First of all, HAPPY NEW YEAR!!! Wish you and your family another fruitful year ahead.

    To answer your question: Power Query is the best way to trim. 🙂

    Btw, if Power Query is not available, then formula would absolutely do... but did you forget to mention also Char 32?

    One more question: Is the trailing minus meant to be a negative number? Maybe only the sender knows... 🙂

    Cheers,

  2. Duncan Williamson says:

    I know these spaces can be a real pain but these days I advise Excel users to learn and use Flash Fill and that will learn what to do pretty quickly.

  3. David Hager says:

    Highlight range to be cleaned. Then, in Replace, hold down the Alt key and type 0160. Replace with nothing.

  4. Steve Jones says:

    I accomplished this by writing a macro to go through all the possible unprintable characters. Looped through the range.

  5. Ramnath D says:

    I use a different method here. First, I will copy the data from Excel and paste it in a notepad. In Notepad, I will do a Find Blanks (Space " ") and Replace (Empty) with nothing.

    Then you can copy the data from Notepad and paste it back to Excel which will be a perfect number as you desire.

    But Thanks for the formula. Its probably the 2nd out of 8 tricks as Chandoo mentioned. Waiting for the rest among 8 from other users 🙂

  6. Andrew says:

    I don't understand the x's. Why weren't they removed in the formula? Or are they part of some sort of numeric formatting that I'm not familiar with? I saw how you handled the non-breaking spaces and the dashes, but am confused about what role the x's played in all this.

    Thanks!

    • NARAYAN says:

      Hi Andrew ,

      The xs have been used solely to demarcate the actual data text ; thus , without the x in place at the end of text , as in :

      x 4,124,500.00 x

      it would be impossible to know that there are unwanted trailing characters , in this case , after the last 0.

      These xs are not part of the original data text , nor are they used in the formulae ; they are put in only so that readers can visualize the individual items of data as they are in practice. Think of them as imaginary delimiters.

      • Andrew Patceg says:

        Oh, that makes sense! Thank you for the explanation. I had a feeling it was something along those lines.

  7. Mucio says:

    You can type this character using the Keys Alt+0160.
    Very useful to replace this Character using Find and Select resource.

  8. Neva says:

    For many years, my jobs have included ETL tasks and I built this macro to help long, long ago. I tweak it every now and again. Many co-workers, past and present, have it wired to a button on their toolbar.

    Sub Clean_and_Trim()
    'CAUTION: Strips leading zeroes -- do not use on zipcodes, etc.

    If Application.Calculation = xlCalculationAutomatic Then
    Application.Calculation = xlCalculationManual
    Revert = 1
    ElseIf Application.Calculation = xlCalculationManual Then
    Revert = 0
    End If

    For Each Cell In Selection
    For x = Len(Cell.Value) To 1 Step -1
    If Asc(Mid(Cell.Value, x, 1)) = 160 Then
    Cell.Replace What:=Chr(160), Replacement:=" ", LookAt:=xlPart, MatchCase:=True
    End If
    If Asc(Mid(Cell.Value, x, 1)) = 32 Then
    Cell.Replace What:=Chr(32), Replacement:=" ", LookAt:=xlPart, MatchCase:=True
    End If
    Next x
    If Cell.Value "" Then
    Cell.Value = Application.Clean(Application.Trim(Cell.Value))
    End If
    Next

    If Revert = 1 Then
    Application.Calculation = xlCalculationAutomatic
    ElseIf Revert = 0 Then
    Application.Calculation = xlCalculationManual
    End If

    End Sub

  9. Brigitte Calahate says:

    This is awesome! What if you have several characters you need to have removed? What would be the easiest way as I can imagine there are several ways.?

    # - 35
    $ - 36
    - 62
    / - 47
    , - 44
    . - 46
    " - 34
    : - 58

  10. Roby says:

    This is typical case of a Fitbit data export to Csv file. Each number has CHAR160 as thousand separator.. how smart Fitbit, thank you 😉

    By the way, i prefer to copy the character, and use find and replace.

  11. Suhas Shetty says:

    Sometimes it happens if you copy a table from outlook and paste it in excel. When you apply formula on those cells you will get error. What i use to do is
    copy one character that looks like space,
    select the entire range,
    go to Find and replace,
    Paste the copied character in Find option
    Leave the replace option unfilled..
    click on replace all..

    All the errors shall be converted in to proper values..

    Process looks lengthier.. but it is one of the simplest method

  12. Gerry says:

    If Clean, Trim, and Substitute, or Find and Replace does not complete the job, I usually enter a value of 1 in an empty cell. Copy the Value of 1, Highlight the range of text numbers, and Paste Special, Values, Multiply. This site is great!

  13. king faisal says:

    You can use Dose for Excel Add-In that can quickly clean huge data with one click besides more than +100 new functions and features to add to your Excel to save time and effort.

    https://www.zbrainsoft.com

  14. R.Ranjit says:

    Hi,
    I have a problem in excel. The sheet attached herewith.

    TABLE CONFIG 2/6
    A B C D E F G H
    1 WEIGHT1 43,599 WEIGH2 62500 WEIGHT3 77000 WEIGHT4 66,500
    2 DEDUCTION1 15,000 DEDUCTION1 15,000 TEMP 0 DEDUCTION2 11,005
    3 RESULT 58,599 RESULT-1 77,500 RESULT-2 77,000 RESULT-3 77,505
    4 RESULT SUBSTRACT 0 0 0
    5 REQUIRED VALUE 77,500 77,000 77,505

    Note: 1- RESULT (58599) IS TO BE DEDUCTION EITHER FROM D4 OR F4 OR H4 WHICHEVER IS MOST
    LEAST CELL AMONG RESULT-1 OR RESULT-2 OR RESULT 3.
    2-HENCE, RESULT VALUE $B$3 IS TO BE PRESENTED ON CELL EITHER D4 OR F4 OR H4 WHICHER IS
    MOST LEAST VALUE
    3-FORMULA =IF(E8<H8,$B$9,IF(E8<J8,$B$9,IF(H8<J8,$B$9,IF(H8<E8,$B$9,IF(J8<H8,$B$9))))))
    CREATED ON CELL D4,F4 & H4 DID NOT WORK.
    PLS FOR YOUR HELP.
    THANK YOU

Leave a Reply