Introducing…Structured References for PivotTables

Share

Facebook
Twitter
LinkedIn

Howdy folks. Jeff here, bringing you a Public Service Announcement: Thanks to the magic of VBA , Structured PivotTable References are coming to a PivotTable near you!

Formula

Structured References for PivotTables? So what? Well, because PivotTables are the best bit of ‘old’ Excel, and Tables are the best thing about ‘new’ Excel, and it’s about time their strengths were brought together:

  • Tables magically expand to accommodate anything you put in them. Even better, because of the automated Dynamic Named Ranges built into Tables – called Structured Table References – any Formulas, Charts, Data Validation lists, or conditional formatting formulas that point to that table will instantly be updated with the latest data. And any PivotTables that point to that table will automatically include the new data whenever you refresh them. (Read more here).
  • PivotTables allow you to do serious yet effortless number crunching without the need for a single formula. Just as well, because the kinds of formulas you need to replicate what a PivotTable can do easily are often mind-bogglingly complex, and very resource intensive. So using a PivotTable instead of formulas means that people that inherit your spreadsheet are less likely to struggle to follow what you’re doing, and the spreadsheet is less likely to suffer from slow recalculation issues. (Although yes, you will have to refresh that PivotTable from time to time. But that’s a small price to pay.) But there’s a problem with PivotTables: they don’t have any kind of inbuilt Dynamic Named Ranges like Tables do. And so because their structure is very likely to change whenever new data is added or a user decides to filter or rearrange the order or number of field displayed, then any formulas that point at PivotTable ranges will have to be changed manually. (With the exception of a single cell in the Data area referenced by the GETPIVOTDATA() function). So PivotTables are great for getting a result, but lousy for passing on those results to other parts of your spreadsheet.

 

Who knows why MS haven’t already implemeted Structured Referencing for PivotTables. But why wait for Microsoft to get around to it. Let’s just do it ourselves!

Download the sample file to see my hand-built Structured PivotTable Referencing in action: DynamicPivotRanges_20141019 unprotected

Open it, enable macros, and you’ll see a PivotTable like this:

Pivot

Now, click on the arrow to the right of the name box, and you’ll see this:

Name Box

As you can see, in my implementation of Structured PivotTable References, the automatic name that gets generated is prefixed with the Sheet name for uniqueness and uses a period to separate the Sheetname, PivotTable name, and FieldName. So it differs slightly from the notation that Tables use. But it’s every bit as handy.

For instance, check out what happens when I start typing a formula somewhere:
Formula

Awesome: That’s pretty much the same kind of thing I get when I want to reference a Table:

Formula_Table

Let’s see if it handles changes in the structure of a PivotTable, shall we? Here, the Pivot is filtered in such a way that only 5 rows of data are returned. I’ve selected the entire State region, so that you can see that this corresponds with the automatically generated Structured PivotTable Reference shown in the Name box:

PT 5 items showing

If I change the City filter to include additional cities, then the data returned grows by a few rows, as you can see below. Check out how the Structured PivotTable Reference automatically updated to accommodate the extra rows:

PT 8 items showing

…and if I change the layout of the PivotTable by bringing in a new field – such as the BloodType field shown below – then as you can see, the Structured PivotTable Reference picks up the change too, and recognizes that the State field has shifted to the right:

PT Structure Change

If you change the Sheet name, then the SheetName part of the Structured PivotTable References syntax get updated next time the Pivot gets refreshed. And if you change the PivotName, then that part of the Structured PivotTable References syntax gets updated immediately. Unfortunately the same doesn’t occur for changes to PivotField names. So if you change the name of a field, any formulas pointing at the associated Structured Reference will need to be updated. This is shown below:
Before rename

During rename

FormulaBar

After rename

So there you have it: a proof-of-concept implementation of Structured PivotTable References. I’ve been using this to create complicated non-PivotCharts from Pivots, such as ScatterPlots (which are not supported in PivotCharts), or to serve up data labels to non-Pivot charts. And also to avoid having to have lots of extra formulas down the side of my PivotTable just to handle growth.

Take it for a spin, and let me know your thoughts and suggestions for improvements in the comments. Who knows…someone at Microsoft might even see this, and think “Now why didn’t WE think of that?”

What other functionality is missing from Excel that you’d like to see added?

While the things that Excel can do are cool, Excel often makes us jump through an awful lot of hoops – and click through an awful lot of dialog boxes – in order to actually do them. At the same time, there’s lots of things we routinely do that Excel simply doesn’t provide tools handy tools for. The end result is this: for every millisecond that Excel actually does some real work, we’ve probably spent hours ‘prepping’ it to do it.

Whenever we have to do lots of manual steps in order to leverage Excel’s cool inbuilt functionality, then Excel is programming us. It’s like some kind of epic experiment in behavioral psychology; and we’re the mice. It should be the other way around.

Fortunately, VBA (Macros) gives us the means to program Excel so that it behaves like we want it too. So if there’s something you would like to see added to Excel, let us know in the comments. We’ll see what we can collectively do to make Excel even greater than it already is!

—Edit—
My pal Doug Glancy actually wrote a post on how to do this back in 2012, on my birthday no less. I’d clean forgotten about that post. So be sure to check out Doug’s implementation of this too.

About the author

Jeff
Yep, that’s me all right. Jeff Weird. Excel Madman.

If you liked this post, then you’ll love my upcoming book: Excel for Superheroes and Evil Geniuses. Keep a lookout for it in early 2015, and check out my posts on this blog or over at Daily Dose of Excel to get a feel for what kinds of things I’ll be covering. The book will give users an excellent overview of how Excel works under the covers, and what tools the interface puts at their fingers right out of the box. And it will ship with free code that will add amazing new features and functionality to Excel. You’ll be an Excel Evil Genius in no time!

Stay tuned…

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

40 Responses to “Lost Excel Functions”

  1. Luke M says:

    Of all the functions, I think the BAHTTEXT function is the biggest "Why is this here???"
    It's use would be limited to a very, very small demographic. A better function would have been a generic translate function where you pick the language (even if it was only the top 5 or something...)

  2. Kevin says:

    Lost by whose definition? Some people use these functions(me). There are alot of words in English dictionary that aren't used.

  3. This is a great post, especially because I love Lost. Thanks!

  4. SteveT says:

    Nice Post Hui. It is amazing what is in the program that you have never heard of. I typed in =d and looked at the functions. "Delta" popped out although it is documented, why would you ever use it vs. just comparing with an equal sign (=1=1).

  5. Ninad Pradhan says:

    I use Datedif at times. What will be nice is if alternatives to these "Lost" functions can also be posted with examples. That'll be a good reading and also deter users from using functions "soon to be made obsolete"

  6. OlaSa says:

    I don't think the intersect AND logic is very well documented:
    =B1:B3 A2:C2 One intersection
    =SUM(D9:F9 E8:F10) Two intersections
    =SUM(D9:F9 E8:E10 F8:F10) No intersection --> #NULL! Not seen very often
    There might be a OR logic lurking as well
    //Ola

  7. Fred says:

    Interesting post! 😉

    I found out that only "evaluate" isn't available in my excel 2007.

  8. Prem Sivakanthan says:

    Great post, thanks Hui! 🙂

  9. Hui... says:

    @Fred
    Evaluate is a Excel 4 Macro Function and not a spreadsheet function
    It can only be used in Named Ranges and VBA, not as a spreadsheet function.

    @OlaSa
    I forgot all about the 2 Operators you mention.
    Daniel at Excel Hero has done a story about them at: http://www.excelhero.com/blog/2010/06/which-function-to-use---part-1.html

    @Steve T
    Yes, Delta and Gestep are odd functions and easily replaced with alternative logic.
    These 2 functions may have uses in handling ranges and not just single cells.

  10. juanito says:

    I read somewhere not too long ago (at Daily Dose, possible) that BAHTTEXT is "rumoured" to be a self-interested joke by the MS Excel programmers: although this function would be at least equally useful for other currencies, they did the baht first because they're extremely partial to Thai takeaways and wanted to speed up the turnaround time

  11. Alasdair says:

    ...and why isn't there a reverse ROMAN?

  12. Hi Hui,

    I think you have mis-defined the Result range name because you have made the name relative. The proper formula should have been
    =EVALUATE($A$1).
    NB: I use the technique in this post: http://www.jkp-ads.com/articles/chartanequation00.asp

  13. SteveT says:

    Found this posting with some User Defined Functions and VBA for reversing Roman Numerals:

    http://www.excelbanter.com/showthread.php?t=141566

  14. tra says:

    Hi Hui - Thanks for the post - a little off the excel topic, but wondering what does "you"ll be the full bottle" mean? Have never heard this expression before. 🙂

  15. Hui... says:

    @Tra
    “you'll be the full bottle” is Aussie slang for "You'll know all about it"

  16. Hui... says:

    @Jan Karel Pieterse
    Thanx for the input
    .
    =Evaluate(A1) is ok as long as A1 is the active cell
    It can create problems if it isn't.
    .
    Ideally it should be entered as =EVALUATE(SheetName!$A$1)
    I have updated the post accordingly

  17. Luke M says:

    Further info on DELTA:
    Have 1 cell formatted to number (a1), and the other formatted to text (a2).
    Type the number 1 into both cells
    The formula:
    =A1=A2
    returns FALSE (number does not equal text)
    formula:
    =DELTA(A1,A2)
    returns 1 (the equivalent of true). I see limited places where this would be useful, but wanted to point out that they do function differently.

  18. Hui... says:

    In Excel2010
    I just tried Delta with
    2 2 =Delta(A2, B2) =1
    '2 '2 =Delta(A3, B3) =1
    '2 2 =Delta(A4, B4) =1
    C C =Delta(A5, B5) =#Value!

    Lines 3 & 4 should also give errors but don't ?

    The formatting of the cells shouldn't affect the results as that is just for display

  19. Ed says:

    Great post.

    Interesting that the roman function returns a #value! if you go any higher than 3999

  20. @Chandoo Not trying to be a shameless self promoter (I just want to spread the Excel awesomeness) but I've found an obscure way to create a mouse-over effect in Excel using the Hyperlink() formula and some VBA. I've used this technique in some of my dashboards at work, and as an example of how it's useful, you could use it in the Grammy Bump chart to simply let users rollover a year instead of clicking on it. I talk about it in the latest post of my rarely updated blog which is linked on my name in this post. Or, here's the long and short of it:
    .
    =HYPERLINK(MyFunction(), "Mouseover me!")
    .
    Then in some module:
    Public Function MyFunction()
    Msgbox "hi!"
    End Function
    .
    To test: place your mouse over the underlined portion of the cell. To make the entire-cell a mouse over target (not just the underlined portion), word wrap it. Also, if you want the function to change parts of your spreadsheet, you'll need to wrap the Hyperlink formula in an IFERROR (you'll see what I mean when you try it). Or you can read about it by clicking on my name, either way, make sure to have fun!

  21. Luke M says:

    @Hui
    Seems like DELTA has the advantage in being able to recognize "text as numbers". And yes, thanks for clarifying my statement about formatting. I should have been clearer in the fact that I just wanted to compare a text string with a number...in which case, maybe I should have just written:
    =DELTA(1,"1") 'Results in 1

  22. Chandoo says:

    @Jordan... wow, that is a beautiful trick. I have not yet tested it, but seems like it has lots of potential. Let me play with the idea and may be write a follow-up article on this.

    Btw, you are welcome to share information and links. That is the whole point of commenting. 🙂

  23. SteveT says:

    Alright, i am no engineer, but a simple formula can also do what Delta does without having a whole function for it. That is like creating a function called Add (Syntax =Add(a1,a2) that results in the addition of A1+A2

    This will do what delta does on numbers and textNumbers and its not rocket science or structural engineering 🙂 🙂

    =VALUE(A1)=VALUE(A2) will also yield true/false

    And if you need the result as a number =(VALUE(A3)=VALUE(A4))*1

  24. myckolah says:

    @SteveT
    You know, they invented this function you described in Excel. It is called SUM, not ADD 🙂
    There are also functions PRODUCT, SUMPRODUCT and others. All of them simple definied, and it doesn't mean they aren't to be in Excel.

  25. Doug Jenkins says:

    Of the under-used functions, I think Evaluate is probably the most useful.

    The short UDF presented here:
    http://newtonexcelbach.wordpress.com/2008/04/22/evaluate-function/
    allows Excel to evaluate functions entered as text, without the need to create named ranges.

    An application using this function can be downloaded here:
    http://newtonexcelbach.wordpress.com/2008/03/25/section-properties-of-defined-shapes-spreadsheet/

  26. Jaspal says:

    thanks for this. I hope to use "convert" more frequently henceforth

  27. Andrew says:

    @ruvelk and @Chandoo

    I checked out the link you provided (ruvelk) and the explanation given of the intervals 'MD' 'YM' AND 'YD' provided above (Chandoo) and the information is not quite correct.

    'MD' returns the number of days since the last completed month.
    'YM' returns the number of months since the last completed year.
    'YD' returns the number of days since the last completed year.

    As far as I can see there is no flaw in the function just perhaps a misunderstanding of what is does.

    eg
    using the 'MD' interval
    02/28/2010 to 01/11/2011
    Last completed month = 12/28/2010
    Number of days between 12/28/2010 and 01/11/2011 = 14

    Using 03/01/2010 to 01/11/2011
    Last completed month = 01/01/2011
    Number of days between 01/01/2011 and 01/11/2011 = 10

    Cheers

    Andrew

  28. Hui... says:

    @Andrew
    I think we are talking about the same thing in different ways.

    From the post:
    "md" Days Excluding Years And Months Complete calendar days between the dates as if they were of the same month and same year.

    so using your dates
    28/2/10 to 11/1/11 will count 29, 30 and 31 as if they are in January and then the first 11 days in January = 14 days.
    That is, it is counting the dates as if they are both in January, same year, and so there is 14 days between them.

  29. Chandra SEkhar says:

    Hi,

    Can any one tell how to enter data into range of cells through a single cell without the help of VBA.

    Regards
    Chandra

  30. Phil Bornemeier says:

    @Chandra
    If you type this into A1:
    ={1,2,3;4,5,6;7,8,9}
    then select A1:C3 and use Control+Shift+Enter
    You will get a 3x3 array in A1:C3
    The formula in each cell in that range will be:
    {={1,2,3;4,5,6;7,8,9}}

    Commas separate columns.  Semicolons separate rows,

    This is of limited use since the cells in this array cannot be individually edited.

  31. Phil Bornemeier says:

    There is at least 1 Excel 4 macro that provides functionality that cannot (AFAIK) be replicated in later versions of Excel.  GET.CHART.ITEM is used to get the exact coordinates of chart elements, including the coordinates of individual points in a line graph (or edge and corner cordinates of bars, or columns for those types of graphs).  For example:
    sngXPos = ExecuteExcel4Macro("get.chart.item(1,1, ""S2P" & lX & """)")
    returns the X position of each point in series 2 of a line graph as you iterate from 1 To ActiveChart.SeriesCollection(2).Points.Count

    Documentation file for Excel4 macros available at:
    http://support.microsoft.com/kb/128185

    Excel 2010 has incorporated most (but not all?) of this functionality as described here:
    http://blogs.office.com/b/microsoft-excel/archive/2010/02/16/migrating-excel-4-macros-to-vba.aspx

  32. stansult says:

    Unfortunately, I don’t see Evaluate working in Excel 2010.
    I have Microsoft Office Professional Plus 2010.
    When I try it myself, or download the example file, I have #NAME?
    result in the cell containing “=Result” formula.

  33. […] To know how many months are left between TODAY() and date in A1, use = DATEDIF(TODAY(), A1, “m”). Related: How to use DATEDIF function. […]

  34. […] To know how many months are left between TODAY() and date in A1, use = DATEDIF(TODAY(), A1, “m”). Related: How to use DATEDIF function. […]

  35. Marty says:

    I once ran across an undocumented version of GETPIVOTDATA. The syntax was something like "GETPIVOTDATA($A$3, ...", where $A$# would reference the pivot table then you could concatenate text fields to select the specific data you were after. I found this useful as I could use an IF("condition", "place field text", ""). This way if the "condition" was met it would field data requested otherwise nothing was included. This worked well if nested condition were not available. Hope this is clear. I can't find the alternate syntax for GETPIVOTDATA anywhere. Does someone have it?

Leave a Reply