Modular Spreadsheet Development – A Thought Revolution

Share

Facebook
Twitter
LinkedIn

This article is written by Michael Hutchens from Best Practice Modelling.

This article provides a high level overview of Modular Spreadsheet Development principles. In next part the implementation of these concepts will be discussed.

Modular Spreadsheet Development – An awesome concept

I want to share a concept with you so awesome that once you understand it you may never use Excel the same way again.

This concept, called Modular Spreadsheet Development, makes it possible to build spreadsheets exponentially faster while reducing the risk of errors and making spreadsheets much easier to understand.

This concept is not completely new, but I’m writing this article because the spreadsheet modelling world would be a much better place if it was more commonly adopted.

An idea born through necessity

It took me three months to build my first model after I became a professional financial modeller in 2002. It was a model of a large energy company, and it’s safe to say I didn’t get a lot of sleep during that three month period.

The second model I built was of a water company, and I realized that although it was a different business, large parts of the model required the exact same logic as my energy company model. So instead of starting from scratch, I created a copy of my energy model, deleted the parts that didn’t apply to my water company, and instantly had over half my water company model built within a day.

The third model I built was of a toll road company, and once again I realized that the majority of the model required identical logic to parts of my energy and water models. This process was more complicated, because I had to copy, cut and paste pieces out of both of my prior models, but compared to building from scratch it was relatively easily. And I got a lot of sleep.

Never repeat yourself

Within one year of starting my financial modelling business I had already developed an obsession with efficiency. It just seemed insane to spend days and nights repeating tasks that I’d done the last time I’d built a model. Two things had become clear:

  1. Templates don’t work; and
  2. Large parts of many models are identical to parts of other models that you or someone else has built previously.

So my obsession turned to finding a way to re-use and share parts of models, so that I could build more models quickly and easily instead of re-inventing the wheel each time.

Re-using and sharing ‘modules’

The answer fell into my lap one day in 2005 thanks to a hero-worthy depreciation formula written by one of my colleagues. The formula was much shorter than any depreciation calculation I’d ever seen before, and I immediately wanted to use it in every financial model I built from that day on.

I asked my colleague to strip everything out of his model except for the depreciation parts, leaving only two sheets containing depreciation assumptions and outputs respectively. He obliged, and soon-after sent me an email with his fixed assets module attached. In diagrammatic form, it looked something like this:

fixed_assets_module - Modular Spreadsheet Development

This was a revolution for everyone in our firm. We never needed to model depreciation from scratch again. And we knew the calculations were correct so there was minimal risk of errors each time we re-used the module.

We immediately recognized that through compartmentalizing complexity into modules, we could re-use and share content when building models like Legopieces. We started building models in a fraction of our prior model development times.

Modules, modules, modules

It’s safe to say that I’ve become obsessed with building, re-using and sharing modules. Whether it’s a valuation module, a dashboard module or an income statement module, each one feels like an app I’ve developed for an App Store, and I always take great pride in sharing my most impressive modules with anyone who’s interested in using them.

My colleagues have also become obsessed with modules, and between us we’ve developed over 3,000 of them over the past 9 years, allowing for different time frames and levels of sophistication. Here’s an example of just a few of the revenue modules we’ve built and use all the time:

  • Revenue (Amounts)
  • Revenue (Amount & Growth Rates)
  • Revenue (Amounts & Growth Rates)
  • Revenue (Prices × Volumes)
  • Revenue (Real & Nominal Outputs)

It’s a whole new mentality, because each time we build a module we’re aware that it will most likely be re-used indefinitely, so we obsess about making sure it is as perfect as possible.

Infinite potential

One of the awesome things about Modular Spreadsheet Development is that it creates seemingly infinite opportunities to improve the way spreadsheets are built, used, shared and communicated.

The modules within a spreadsheet can be grouped into module areas, such that diagrams can be used to communicate the content of a model, as show below for a basic profitability model:

profitability_model_modules - Modular Spreadsheet Development

Relationships between modules can be shown using module links diagrams, as shown below for a basic income statement module:

Basic Income Statement Module - Modular Spreadsheet Development

Furthermore, every element of the modelling process can be systematized based on a modular approach. Our firm now scopes and builds all models on a module-by-module approach, often working in teams by allocating different modules to different team members.

We also train and assess staff making sure they understand each module so that they can then use different combinations of modules on different projects without ever re-inventing the wheel.

Basic example

The following Excel workbooks provide a basic example of the implementation of Modular Spreadsheet Development, in this case to forecast earnings over a five year period. The first workbook contains revenue, expenses, income statement and dashboard summary modules sourced from the subsequent four workbooks respectively, which each contain a single module:

Each of these modules could be exchanged with other modules to change the model functionality. For example, the Revenue (Amount & Growth Rates) module might be exchanged with a Revenue (Drivers) module to base the revenue forecasts on prices and volumes rather than growth rates. And this could be done without affecting the integrity of the other modules in the workbook.

This process will be discussed in more detail in the second part of this series.

More information

I truly believe that the spreadsheet modelling world should be creating and sharing modules like free apps in an App Store. We’d all save time, build better models, reduce spreadsheet errors, and help maintain and improve Microsoft Excel’s reputation as the world’s leading analytical tool.

I have created an 83 second movie explaining Modular Spreadsheet Development, which you can access via the following link:

http://www.bestpracticemodelling.com/chandoo/msd

You can also download the following PDF document:

Modular Spreadsheet Development – Fundamentals

Added by Chandoo

Modular development is not a new concept. In software industry, modular development is one of the first things you learn. Even those of you who are using Excel alone, have relied on modules all the time, in the disguise of VBA functions, add-ins, classes etc.

But this is the first time, I am seeing modular development applied to spreadsheet models. I am excited to try these concepts when developing dashboards or models.

What about you? Have you heard about MSD? Did you come across any models developed with these concepts? Please share your thoughts and concerns using comments.

More on Modeling Best Practices:

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

24 Responses

  1. I’d suggest simply using the subtotal function and filtering the data using the Win/Loss column.  You get the same results and the formula is more comprehensible.

    1. @John

      That is one option.

      There are times however when you want to see the whole data table or a filtered subset and still want to produce summary reports against an unfiltered field.

  2. Is there a particular reason why you are using a comma and the unary (–) operator for the second array in the SUMPRODUCT formula?  It seems to work the same if you were to string the arrays together using the asterisk (*).  The advantage is that SUMPRODUCT treats the entire string of arrays as a single array.

  3. Is there a way to do this on a large set of data? As in ~100,000 rows? When I try I get an error because the formula becomes too long. It says the max length of a formula is 8,192 characters. Excel 2010.

  4. How do I incorporate a specific text within a cell for the second array. For instance, – -(C7:C13=”Apple”)
    when I chose a specific text the formula does not work.

    1. @RB

      I am not sure what is the issue as if I use the sample data in the post the following work fine

      Count:
      =SUMPRODUCT(SUBTOTAL(3,OFFSET(C7:C13,ROW(C7:C13)-MIN(ROW(C7:C13)),,1)), –(C7:C13=”L”))
      Sum:
      =SUMPRODUCT(SUBTOTAL(3,OFFSET(C7:C13,ROW(C7:C13)-MIN(ROW(C7:C13)),,1)),(C7:C13=”L”)*(D7:D13))

      You may want to check that there are no leading or trailing spaces in your list of Apples

      1. I should have given a better explanation. Heres my situation. I have a column with cells filled with names like Column 1, Column 2, Pier 1, Pier 2, etc. If the cell just contained Pier and searched for that it works. But because it has other characters in the cell its not recognizing the pier. So how can I extract specific characters of a string of text in this formula?

        Hopefully this was a better explanation

  5. Hello-

    This formula works pretty well for me except that it slow down excel and prevents some of my macros from working. I was wondering if there was a way to program this in VBA so that excel isn’t always trying to recalculate it. I would like to use a push of a button to get it to run then paste in a cell.

    Thanks!

  6. I am trying to sum filtered data in a column, but would want to ignore the negative values in the column. How to go about doing this?

      1. The negative values are required for reporting purposes, but their effect on the total is distorting the required output. Please advise.

  7. I have this working for counting and summing, however, I have a list and for the second array, I need a criteria. That is, I’m looking for b13:b200=”01.??.??” or =left((a1,2) or something like that. These types of criteria matches do not appear to work as I get a blank as a result.
    Thanks!

    1. @Bob

      As your formula b13:b200=”01.??.??” looks like you are trying to check the first day of the month of the range
      What about trying Day(B13:B200)=1

  8. Hai Experts,
    i understood this formula well and working fine in MS Excel 2013
    but when the same am trying to place in google Spreadsheet it shows error as
    “SUMPRODUCT has mismatched range sizes. Expected row count: 1. column count: 1. Actual row count: 2014, column count: 1.” and as a result #VALUE! Appears in cell.
    Can anyone please help me how would i get it done in Google Spread sheet
    or is there any other formula as a substitute for this.
    Thank you very much.

    1. @Vivek

      I don’t know

      I just downloaded the file and it is working fine and not showing that error

      Goto the Formulas, Calculation Options Tab and check that Calculation is set to Automatic

      What version of Excel and Windows are you using ?

  9. I know that this forum is for MS Excel, but I am trying to help someone who is working in Google Sheets. The below formula works in Excel but Google Sheets returns:
    “SUMPRODUCT has mismatched range sizes. Expected row count: 1. column count: 1. Actual row count: 39000, column count: 1.” and as a result #VALUE! Appears in cell.
    This is the same problem asked by Srichirin above. Does anyone know if there is a formula for Google Sheets that will replicate what MS Excel does?

    =SUMPRODUCT(SUBTOTAL(3,OFFSET($C$6:$C$39500,ROW($C$6:$C$39500)-MIN(ROW($C$6:$C$39500)),,1)),- -($C$6:$C$39500=H1),($D$6:$D$39500))

  10. Trying to find a SUMPRODUCT formula that counts the word Closed by date for the last 7 days in a filtered list.
    =COUNTIF(M:M,”>”&TODAY()-7) works ok for unfiltered count Column M contains Closure dates (blank if open) and Column L is Status Open or Closed

  11. I used this formula and worked like a charm! But, now I’ve been requested to use it but adding not one but two criteria in the same formula. For instance the sum I was doing added negative and positive numbers. I’ve been asked to use the exact same formula but adding that only positive numbers were considered… any idea on how to do this?

  12. Thank you so much brother literally I have been struggling since morning to get the sum of the filtered category, however, after reading your blog attentively i got my solution, so thanks a lot once again.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.