How to use Excel Data Model & Relationships

Share

Facebook
Twitter
LinkedIn

Have you ever been in a VLOOKUP hell?

Its what happens when you have to write a lot of vlookup formulas before you can start analyzing your data. Every day, millions of analysts and managers enter VLOOKUP hell and suffer. They connect table 1 with table 2 so that all the data needed for making that pivot report is on one place. If you are one of those, then you are going to love Excel’s data model & relationships feature.

Table relationships & Data model feature of Excel - cartoon

In simple words, this feature helps you connect one set of data with another set of data so that you can create combined pivot reports.

Practical Example – V(X)LOOKUP hell vs. Data Model heaven

Lets say you are looking sales data for your company. You have transaction data like below.

Example data

And you want to find out how many units you are selling by product category and customer’s gender.

Unfortunately, you only have product ID & customer ID.

With VLOOKUP Hell,

  1. You first fetch all the customer and product data and place them in separate ranges.
  2. Then write a vlookup formula to fetch product category, another to fetch customer gender.
  3. Then fill down the formulas for entire list of transactions.
  4. Now make a pivot table.

Assuming you have 30,000 transactions, you have to write 60,000 VLOOKUP formulas to create this one report!!!

With Data Model heaven,

  1. Create relationships between Sales, Products & Customer tables
  2. Create a pivot table

Creating a relationship in Excel – Step by Step tutorial

  1. Relationship feature in Excel 2013 data ribbon tab
    First set up your data as tables. To create a table, select any cell in range and press CTRL+T. Specify a name for your table from design tab. Read introduction to Excel tables to understand more.
  2. Now, go to data ribbon & click on relationships button.
  3. Click New to create a new relationship.
  4. Select Source table & column name. Map it to target table & column name. It does not matter which order you use here. Excel is smart enough to adjust the relationship.
    Creating a new relationship in Excel 2013 - how to?
  5. Add more relationships as needed.

Using relationships in Pivot reports & analysis

  1. Select any table and insert a pivot table (Insert > Pivot table, more on Pivot tables).
  2. Make sure you check the “Add this data to data model” check box.
    Adding a pivot table with data model in Excel 2013
  3. In your pivot table field list, check “ALL” instead of “ACTIVE” to see all table names.
  4. Select fields from various tables to create a combined pivot report or pivot chart

Example: Category & Gender Sales Report

  1. Add category to row labels
  2. Add gender to column labels
  3. Add quantity to values
  4. and your report is ready!
Example Pivot report made with Excel data model

Things to keep in mind when you using relationships

  • Same data types in both columns: Columns that you are connecting in both tables should have same data type (ie both numbers or dates or text etc.)
  • One to one or One to many relationships only: Excel 2013 supports only one to many or one to one relationships. That means one of the tables must have no duplicate values on the column you are linking to. (for example products table should not have duplicate product IDs).
  • You can add slicers too: You can slice these pivot tables on any field you want (just like normal pivot tables). For example, you can further slice the above report on customer’s profession or product’s SKU size.

Benefits of Data Model based Pivot Tables

Once you have a data model in spreadsheet, you will enjoy several benefits (apart from multi-table pivots that is). They are,

  • Distinct counts: This simple but often tricky to calculate number is easy to get once you have data model based pivot. Just go to value field settings and change the summary type to “Distinct count”. Here is a tip explaining how to get distinct counts in Excel pivots.
  • Measures & DAX: Once you have a Data Model, you can unleash the full Power Pivot features on your workbook. You can create measures (using DAX language) and calculate things that are otherwise impossible with regular Excel. Here is an example of percentage of something calculation with DAX & Data Model, to get started.
  • Pivots from data in other files & databases: You can combine data model with the abilities of Power Query to create pivots from data in other places. For example, you can make a pivot from sales data in SAP with customer data in CRM system. Here is an overview of what is Power Query?
  • Pivots from more than 1mn rows of data: You can connect to very large datasets and make pivots from them with the help of data model. Here is a demo of how to set up data model for 1+mn rows of data.
  • Convert Pivot Tables to formulas: Once you have a data model based pivot table, you can turn it in to a set of formulas. You can access this feature from “Analyze” ribbon. This will replace your pivot with a bunch of CUBE formulas. Here is an overview of CUBE formulas.

Drawbacks of Data Model:

Of course, its not all cup cakes and coffee with Data Model. There are a few drawbacks of data model based pivot tables.

  • Compatibility: Data model & relationship feature is available only in Excel 2013 or above. This means, you cannot create or share such pivot reports with people using older versions of Excel.
  • Not able to group data: In regular Pivot Tables, you can group numeric, data or text fields. But with data model pivot tables, you can no longer group data. You must create another table with the group mapping and use it as a relationship.

Download Example File

Click here to download Excel data model demo file. It contains 3 different tables and a combined pivot report (with slicer) to show you what is possible.

Do you use relationships?

Ever since discovering PowerPivot, I kind of stopped using VLOOKUP (or XLOOKUP) for most of my own analysis. Now that relationships are part of main Excel functionality, I am using them even more.

What about you? Are you using relationships & data model in Excel? What cool things are you doing with it? Share your tips with us using comments.

Want even more? Try PowerPivot

If you want even more out of your reports, then try PowerPivot. It is a new feature in Excel 2013 (available as add-in in Excel 2010) that can let you do lots of powerful analysis on massive amounts of data. Here is an introduction to PowerPivot.

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

46 Responses to “6 Best charts to show % progress against goal”

  1. Andreas says:

    Chandoo, thanks for another interesting post.

    One thing I'm missing is the question: What is progress, what does one want to know exactly?

    I'm asking the question because I think of progress as not the same as "state of completion." Percentages/bars, etc., as shown above, are great to communicate state of completion, but less so for progress.

    That's because project progress is how state of completion *relates to* the resources spent so far. Resources can be things like dollars spent, hours spent or project time passed. For example, 5% would be "good progress" in the first week of a one-year project, but terrible progress in the last week of the project.

    The way I prefer to report progress is as a simple line chart with time on the x axis, and maybe a marking for the end point (and maybe an "ideal"/"as planned" line).

    If it really must be a single number, you could go a EVA-ish route and divide the current % of completion by the current % of project time passed, which gives you a schedule performance index (1 or bigger than 1 = good; smaller than 1 = bad). For this, your suggested charts should work great!

    • David says:

      I avoid 'progress' except where I can objectively assess progress, such as counting bricks laid or concrete poured. For intellectual work, I don't think that its possible to measure progress to completion with any reliability or credibility. I prefer to update forcasts of completion date, because that's where the effect of completion on dependent activities, deliverables and outturn value of the project is felt. This is also referred to as the 0-100 method. An activity is set at 0 complete until its actually finished, when it is set at 100% complete.

  2. Doug H says:

    Hi Chandoo,

    Great post! I have a preference towards thermometer charts too mainly because of the target/actual comparison.

    Just an FYI...seems like the the screen shot for the pies #4 are under the #5 heading. Also the pies conditional formatting is something that doesn't accurately portray completion since the pies are segmented into quarters.

    AND also a little trivia...those "pies" are called Harvey Balls, named after Harvey Poppel...

  3. Eric C. Lind says:

    Chandoo,

    I wonder. Is there a trick to unzipping your files?
    I always seem to end up with a series of XML files rather than an XLSX.

    Thanks a lot. 🙂

    Eric~

  4. Mario says:

    Hi Chandoo,
    Thank you again for this amazing help you are so resourcefull to make us little bit more amazing everyday.

    When I click on the link on the page "http://img.chandoo.org/c/best-charts-for-goal-progress-comparison.xlsx" it is always bringing me to a zip file with all XML files without the XLSX file. I tried with mozilla and IE.

    Thank you

  5. Chandoo says:

    @All having trouble with download file.

    1. Download the file.
    2. Rename the extension as .xlsx
    3. Double click or open it in Excel

    • Ian H says:

      Doesn't make any difference Chandoo, still end up with a zip file full of xml related files/folders

      • Hui... says:

        @Ian H
        Download the zipped file and rename it to *.xlsx
        where * is the filename

        ps: Great name!

        • Ian H says:

          Many thanks for your help Hui but not sure why you are repeating what Chadoo said and which I first posted to because it didn't work for me. I did as he said and it didn't work, hence my post.

          Chandoo says:
          March 11, 2014 at 1:52 am
          @All having trouble with download file.

          1. Download the file.
          2. Rename the extension as .xlsx
          3. Double click or open it in Excel

    • Chandoo says:

      Also, please note that we are investigating an issue with our webserver settings that may be causing this behavior. Sorry for the inconvenience. I am hoping to get this fixed in next 48 hours.

  6. Belle says:

    I used thermometer chart & conditional formatting using traffic lights. I just recently completed a dashboard I hope you can take a look but don't know where to send it. Thanks.

  7. Manoj Varghese says:

    The in-cell bar charts is very interesting. This is not to be used as one can easly do manipulations by changing fonts/ font size etc

  8. Prisha says:

    Hi..this is really helpful..
    but I hve one quick ques..is it possible to hve conditional formating for chart graph based on text value and not the numbers..if I take your example project one bar should be red...if data is project 2 then it should be blue..basically we mke chart based on countries n each countries are assigned specific color...so I want a way where I can use conditionsl formating and not do it manaually each month.

  9. Mark says:

    Hi Chandoo,

    Great article and will be very useful.

    One question - is it possible to have in-cell bar chart and the percentage complete (similar to icons)?

  10. Arup Chakraborty says:

    Hi Chandoo,

    I am a great fan of you since i stumbled upon your blog. Your blog is very informative and insightful. I liked the way you presented the 5 steps using thermometer chart. I was very much inspired by that and tried to make my own version with 20 tasks to complete. On and after 17th step it was going downward. So I wanted to ask you that is there any limitation to thermometer chart

  11. […] shows us the 6 best charts to use, when you want to show your progress against a goal. There’s a sample file to download, so you can experiment on your […]

  12. Istiyak Shaikh says:

    Is there any xhart is available which can show achivement percentage it may 80% or 120% means more an set target.?

  13. Ross says:

    Hi Chandoo,
    Love your site. I have a small question regarding plotting data that contains ranking. I have 2 fields - Country, Rank. Note that i don't have the absolute values from which the rank has been calculated. So what is the best way of showing this on a graph given only the above 2 fields. Appreciate it

    Regds,
    Ross

  14. Vignesh says:

    Dear Chandoo Sir,

    Really awesome post.
    Thanks.

    Vignesh.V

  15. David Macdonald says:

    We can always rely on Chandoo to explain to us clearly things that perhaps we already knew but weren't putting into practice the best way.
    A limit I never liked about data bars was that they are monochrome - one colour for positive values, one colour for negative. So a couple of weeks ago I sat down to figure out a workaround. If anyone's interested...
    http://digimac.wordpress.com/2014/06/29/multicoloured-data-bars-in-excel/

    • David Macdonald says:

      Epic fail on my part! After three months I just found out that what worked on my machine, didn't work on others.
      Problem solved, more functions added.

  16. Brian says:

    The link above at
    To hide them use ;;; custom cell formatting code (how to).
    appears to be incorrect. However, using the downloaded file and selecting a cell(s) from that example provides the easy answer.

    I wondered if the pies could have a color other than black and white (which, of course, would raise the color-blindness issue that you referred to with the traffic lights example).

  17. Aden says:

    Hi Chandoo!

    Thanks for the informative post!

    I have managed to understand and replicate all of the progress graphs except one, the thermo bar. I read up on the tutorial of how to create them, and I understand almost everything about the look and use of the bar, but one problem I am having is that I cannot seem to "center" the bar into the cell like you did. The reason being that even though the highest input (progress) percent is 100%, the program automatically puts in another 20%, so instead of 100% stopping at the end of the graph, it stops 20% short and I have a huge space at the end because of it.

    How did you counter that problem? I have been trying for hours to fix it

  18. Ken says:

    Thanks. I started running a project recently, and I found your charts to be really helpful in tracking it's progress. I'm glad I found your page.

  19. Chulapo says:

    Hi Chandoo!
    Great stuff for my customized project moving forward. However, when I use the blue block bars, the %ages spark up to smt like 5000% and cannot lower them nor scale them. If I input manually such as 50% without formatting a column, the bar for 50% e.g., will fill the cell completely, so that's kind of odd... what to do?
    Thanks!

    • shakira says:

      I guess I have the same problem. When I put 50 and click on the percentage, it is giving me 500%. Can someone help us on this. Thanks in advance

  20. Lisa says:

    Hey,

    Thank you for making this page. I do have one problem with the thermo graphs. Whenever I try to drag the graphs from one cell to the cell beneath it, the data remains selected on the former.

    For example, if I had a thermo with a target number in A1 and an actual number in B1 with my thermo in C1, when I drag my thermo into C2, C3, etc., all of the graphs show the results from A1 and B1.

    Is there a way to have these graphs update automatically as I will be regularly working in an excel file with hundred of entries?

    P.S. I removed the $ symbols from 'Select Data', but that did not fix the problem.

    Thanks again!

    • Hui... says:

      @Lisa

      Not sure but it sounds like the new cells have Conditional formats applied

      Select just the new cells
      Select Conditional formatting, Clear Rules, Clear Rules from selected Cells

  21. Tito says:

    Hi Chandoo.
    I am charting on some defaulter data where greater than zero is not desirable. Problem is that I have to highlight zero as target and anything above as undesirable. Seek your help

  22. Pedro says:

    Hi Chandoo
    Great post!
    But I am wondering why bullet chart is not on this list. Is there a reason for its absence?

  23. Sari says:

    Thank you for these instructions. The bonus 5 Step Progress Meter you included would be perfect for my project. Where can I find the instructions?

  24. Antonio says:

    Hi,
    Do you know of any simple way to reduce the Data Bars padding so that they fit within the cells?
    Thanks and great posy!
    Regards

  25. Adorn Age Defense says:

    Appreciating the dedication you put into your website and in depth information you
    provide. It's good to come across a blog every once in a while that isn't the same out of date rehashed information. Wonderful
    read! I've bookmarked your site and I'm including your
    RSS feeds to my Google account.

  26. Isobel says:

    With #1 and #2, how would you also apply a red amber green to the bars (is it possible within chart formatting or would you need to utilise CF)?

    I'm thinking of an in cell bar of some kind which will show against a known goal end date how far along with the goal you are (this is to be used for 'how many of the X number of people that I need to train in X timeframe, have been trained and therefore which of each training group is on track to complete on time or falling behind'.

    So there would be knowns of number of people, target end date but I'd want it to reflect accurately as some groups of trainees might only have 50 in so their 50% done would be different to a group of trainees where their group had 200 people in it - but 50% would still be the same. Somewhere there'd probably need to be something which noted that there was a different volume of trainees so it could but the remaining effort to train people into context?

    Hope that makes some kind of sense, I could be waffling!

  27. […] charts.  Its got things like “Best Charts to Compare Actuals vs Targets” and “Best charts to show progress“. I love me some charts […]

  28. Nawa says:

    Thanks a lot my dear.
    very Useful it for me.

  29. MarcoX says:

    Another great post, thanks for sharing.

  30. Noah says:

    Chandoo, I am just starting an Excel class, and everything in the class is new to me. I am learning how to use all of these great charts but don't know what they are all used for. Thank you for your post and I think I will be able to use this down the road throughout my business career

  31. in the above charts , Chart #2: Conditional Formatting Data Bars

    ->Assume if we have completed 35% of work it is showing in Blue color ,in the same cell remaining 65% of work should shows in some color , how to show?

  32. RACHIT NAMDEV says:

    Hi Sir,

    This is Rachit and I am a big fan of you and your work. This is to request you please make a video for Beverages Sales performance data analysis in Excel.

    Regards,

Leave a Reply