Howdy folks. Jeff here, bringing you a Public Service Announcement: Thanks to the magic of VBA , Structured PivotTable References are coming to a PivotTable near you!
Structured References for PivotTables? So what? Well, because PivotTables are the best bit of ‘old’ Excel, and Tables are the best thing about ‘new’ Excel, and it’s about time their strengths were brought together:
- Tables magically expand to accommodate anything you put in them. Even better, because of the automated Dynamic Named Ranges built into Tables – called Structured Table References – any Formulas, Charts, Data Validation lists, or conditional formatting formulas that point to that table will instantly be updated with the latest data. And any PivotTables that point to that table will automatically include the new data whenever you refresh them. (Read more here).
- PivotTables allow you to do serious yet effortless number crunching without the need for a single formula. Just as well, because the kinds of formulas you need to replicate what a PivotTable can do easily are often mind-bogglingly complex, and very resource intensive. So using a PivotTable instead of formulas means that people that inherit your spreadsheet are less likely to struggle to follow what you’re doing, and the spreadsheet is less likely to suffer from slow recalculation issues. (Although yes, you will have to refresh that PivotTable from time to time. But that’s a small price to pay.) But there’s a problem with PivotTables: they don’t have any kind of inbuilt Dynamic Named Ranges like Tables do. And so because their structure is very likely to change whenever new data is added or a user decides to filter or rearrange the order or number of field displayed, then any formulas that point at PivotTable ranges will have to be changed manually. (With the exception of a single cell in the Data area referenced by the GETPIVOTDATA() function). So PivotTables are great for getting a result, but lousy for passing on those results to other parts of your spreadsheet.
Who knows why MS haven’t already implemeted Structured Referencing for PivotTables. But why wait for Microsoft to get around to it. Let’s just do it ourselves!
Download the sample file to see my hand-built Structured PivotTable Referencing in action: DynamicPivotRanges_20141019 unprotected
Open it, enable macros, and you’ll see a PivotTable like this:
Now, click on the arrow to the right of the name box, and you’ll see this:
As you can see, in my implementation of Structured PivotTable References, the automatic name that gets generated is prefixed with the Sheet name for uniqueness and uses a period to separate the Sheetname, PivotTable name, and FieldName. So it differs slightly from the notation that Tables use. But it’s every bit as handy.
For instance, check out what happens when I start typing a formula somewhere:
Awesome: That’s pretty much the same kind of thing I get when I want to reference a Table:
Let’s see if it handles changes in the structure of a PivotTable, shall we? Here, the Pivot is filtered in such a way that only 5 rows of data are returned. I’ve selected the entire State region, so that you can see that this corresponds with the automatically generated Structured PivotTable Reference shown in the Name box:
If I change the City filter to include additional cities, then the data returned grows by a few rows, as you can see below. Check out how the Structured PivotTable Reference automatically updated to accommodate the extra rows:
…and if I change the layout of the PivotTable by bringing in a new field – such as the BloodType field shown below – then as you can see, the Structured PivotTable Reference picks up the change too, and recognizes that the State field has shifted to the right:
If you change the Sheet name, then the SheetName part of the Structured PivotTable References syntax get updated next time the Pivot gets refreshed. And if you change the PivotName, then that part of the Structured PivotTable References syntax gets updated immediately. Unfortunately the same doesn’t occur for changes to PivotField names. So if you change the name of a field, any formulas pointing at the associated Structured Reference will need to be updated. This is shown below:
So there you have it: a proof-of-concept implementation of Structured PivotTable References. I’ve been using this to create complicated non-PivotCharts from Pivots, such as ScatterPlots (which are not supported in PivotCharts), or to serve up data labels to non-Pivot charts. And also to avoid having to have lots of extra formulas down the side of my PivotTable just to handle growth.
Take it for a spin, and let me know your thoughts and suggestions for improvements in the comments. Who knows…someone at Microsoft might even see this, and think “Now why didn’t WE think of that?”
What other functionality is missing from Excel that you’d like to see added?
While the things that Excel can do are cool, Excel often makes us jump through an awful lot of hoops – and click through an awful lot of dialog boxes – in order to actually do them. At the same time, there’s lots of things we routinely do that Excel simply doesn’t provide tools handy tools for. The end result is this: for every millisecond that Excel actually does some real work, we’ve probably spent hours ‘prepping’ it to do it.
Whenever we have to do lots of manual steps in order to leverage Excel’s cool inbuilt functionality, then Excel is programming us. It’s like some kind of epic experiment in behavioral psychology; and we’re the mice. It should be the other way around.
Fortunately, VBA (Macros) gives us the means to program Excel so that it behaves like we want it too. So if there’s something you would like to see added to Excel, let us know in the comments. We’ll see what we can collectively do to make Excel even greater than it already is!
—Edit—
My pal Doug Glancy actually wrote a post on how to do this back in 2012, on my birthday no less. I’d clean forgotten about that post. So be sure to check out Doug’s implementation of this too.
About the author
Yep, that’s me all right. Jeff Weird. Excel Madman.
If you liked this post, then you’ll love my upcoming book: Excel for Superheroes and Evil Geniuses. Keep a lookout for it in early 2015, and check out my posts on this blog or over at Daily Dose of Excel to get a feel for what kinds of things I’ll be covering. The book will give users an excellent overview of how Excel works under the covers, and what tools the interface puts at their fingers right out of the box. And it will ship with free code that will add amazing new features and functionality to Excel. You’ll be an Excel Evil Genius in no time!
Stay tuned…
28 Responses to “FIFA Worldcup 2018 Excel Tracker – FREE Download”
Good work as always - I liked the way you did the "menu" on the left hand side (although the buttons aren't lined up between tabs if I'm being ultra picky)
Have you previously written about the method of extracting the Wikipedia page into Power Query? It's not something I recall seeing before.
ps other geeky observsations:
- the bracket columns are too narrow for the date & match number - and will need to be wider still when the team names get populated
- match 51 should be Moscow (Luzhniki) for consistency
- it's not possible to be 23 hours ahead of GMT - the International Dateline gets in the way! I think the maximum is 14. There are also a couple of countries who work to a quarter hour to make it really complicated!
- There's a typo in the how-to - "compated" instead of compared
Thanks for the lovely feedback. I have fixed almost all of them.
1) button alignment: this is tricky as row heights can change between sheets.
2) Column width is fixed now so bracket view looks better
3) Updated the stadium name
4) Did not bother with the 23 hours ahead thingie. This is more of a novelty feature 😛
5) Fixed the type
6) Fixed an issue with live score table. This should work as long as the points table is maintained in wikipedia page - https://en.wikipedia.org/wiki/2018_FIFA_World_Cup
7) I have not discussed the technique of reading all tables on webpage to one big table. Watch out for a blog post on this soon.
Button alignment is one for the ultra-OCD sufferers 😉 There are ways, but only for those with too much time on their hands.
Aah, Excel. The perfect tool for people like us. Everything (cells) is in same shape and size by default and aligned perfectly. 😀
Is there actually a way to copy row heights (in the same way you copy column widths?)
By the way Chandoo, great post. I'm forwarding to my department. I actually use another query from the same page to automatically fill in the team names for the knock-out stages (I made one for round of 16 which I then duplicated and edited for quarter-finals etc.) This is incredible, I was always wondering how to do these type of queries from the web, and now I know 🙂
Hello!
This is quite amazing and incredibly cool to use 🙂
Testing the constraints of this sheets a few errors popped I noticed:
- Vlookup Group E-H refers to column J instead of E (eg. Brazil gets the same points as Russia because the formula looks up Russia twice)
- Power query only has 29 lines, the overview of has 32 but the 3 countries from group A are lost as the overview is refreshed - causing N/A in the group stage colums
@Jake.. thank you. I am sorry for the errors. I could not test the live points table until the games began. I see my folly now. I have fixed both issues and uploaded a new file. As the points table relies on a wikipedia page, if someone decides to change the layout or rename a column it can seriously harm this template. I took some precautions in the Power Query layer to adjust column names dynamically etc, but it is not foolproof.
Try downloading the newer version and let me know if you see something funny.
No worries!
Was able to fix the vlookup myself but the power query had me bit stumped 🙂 And wanted to give you a heads-up to everyone can enjoy it!
Thanks for the awesome sheet!
Hi,
Thanks for sharing this world cup tracker. Certainly makes it more interesting when the data is current. As a newbie, it also helps to have a couple of mistakes to find whether unintentional or not.
Thanks again
Hi,
Your v-lookups in the "Group Stage" tab for groups E, F, G, and H (all the ones under column O) are pointing to the wrong country. They all point to column J, so whatever happens to the countries in column J will also be reflected for the countries in the groups in column O for that same row.
Just thought I'd call that out. Thanks for the great work on this!
@Christian... Thanks for trying this and letting me know about lookups. I have fixed the issue now. Please download latest version for that and few more fixes.
Refresh All did not work correctly. Team names vanished though points were updated.
@Sheeloo... Can you please try with latest version (download again using above links). I tested up to latest Iran's stunning win over Morocco and it works.
Dear Chandoo
Thanks a lot for this worksheet.
However, while refreshing the data, I am getting error message as "Initialisation of Data Source failed".
May I know what version of Excel you are using? Do you have internet connectivity? If you are familiar with Power Query, try tracing the steps in the query editor. And oh, first start with the latest version of file (link above).
@Etienne - yes. Copy row, paste formats will do it, although obviously that will bring the formats of every cell in the row as well as the height.
Latest version seems to be working well.
One request: the Groups & Points tables on the Group Stage sheet have the team names pre-entered. This means they don't get sorted according to the results.
On my copy, I've changed them to a lookup, so they appear in the same order as the points table. It would be good if you can do the same if/when you release a new update!
Here's what I did. It's not the most elegant, but it works, and I didn't have much time to spend on it!
Using helper values of 1,2,3,4 in columns I and N for each group, the formula for the first team name in group A (cell J4) is:
=INDEX(points[Team],MATCH(OFFSET(J4,-(I4),0),points[Group],0)+(I4-1))
This can be copied & pasted to the other team name cells.
Cheers!
Good suggestion. I have made changes to the points table to remove lookups and just show teams in the order they appear in the detailed table. This way, You will see top two teams on first two rows. We could highlight them as well (figured this would make it look like a bowl of M&Ms, so didn't bother) or highlight *YOUR* team.
I consider my Excel skills as above average but far from guru and I love how your little projects like this get me to look at data in a new way. I would like to expand on the data in the points table through the use of some calculations but I am a little challenged by the data coming across as text. The Pts column is easy to deal with, but I'm having problems with the GD. The negative goal differential looks like it may be noted with an en dash instead of a minus sign, but if I search for an en dash in the data Excel doesn't find any. I would like to include conversion to a minus sign in my little macro so I can get everything to numbers but so far I am not having any luck. Any thoughts? Thanks for your help.
Thanks for such kind words 🙂
I suggest adding an extra step in Power Query to convert points, GD & other columns to numbers. You can replace em dash in PQ. I did not do it as this will add another layer of dependency and should the wikipedia page change, one more reason for the query to fail.
As always, an awesome spreadsheet from Chandoo. I love the Power Query score update without macros. The country watch-out is a unique feature as well!
For those who like a predictor template with flag lookup and a ribbon UI, here is our spreadsheet:
https://www.spreadsheet1.com/fifa-world-cup-2018-russia-free-prediction-templates-for-excel.html
Here is our World Cup 2022 template with LAMBDA functions:
https://www.spreadsheet1.com/fifa-world-cup-2022-qatar-free-prediction-templates-for-excel.html
[…] Interesting World Cup Tracker here at chandoo.org : https://chandoo.org/wp/fifa-worldcup-2018-tracker/ […]
Great template!
I came across another one with image vlookups for country flags
https://eexcel.co.uk/downloads (World_Cup_2018_Sweepstake.xlsx)
This is a great Template.
I am running Excel 2010 with the PowerQuery add-in running.
The scores will not update, so I followed the error and the second operation (Fitlered rows) says that the table is empty.
After a few minutes on Wikipedia, I realise that my PowerQuery skills are not good enough to work out what the issue is.
Any suggestions?
I would like to fix it myself is possible.
Thanks,
Sean.
@Sean... Can you try the latest version mate? I think it should work.
Where can I see the results for a specific match?
Thanks!
@Juan... You can now. I have included a results tab that shows match scores. This too is a live table. Just refresh data to get new results. Please download latest version file from links above to use this feature.
PS: There is another version coming soon with all goals too. I just have to spend some more time polishing the Json to table Power Query thingie.