Consolidate data from different excel files (VBA)

Share

Facebook
Twitter
LinkedIn

This is a guest post by Vijay, our in-house VBA Expert.

Last week, we learned how to use SQL and query data inside Excel. This week, lets talk about how we can use VBA to consolidate multiple data sheets from different workbooks into one single worksheet.

Consolidate Data Demo

First, lets take a look at the consolidate data VBA code.

Consolidate data from different excel files

Consolidating Data from different Excel files – the setup

There is one master file (or sheet) which needs to be consolidated by pulling data from multiple source files containing raw data (having the same data structure).

Lets try to make a generic consolidation macro so that we can use this almost anywhere.

We start of by creating a simple table on our sheet, we will call this List.

Definition List

 

  • On this table essentially we are defining everything that our VBA code needs to know to copy and paste data.
  • We start by telling the name of the Excel workbook and then the complete path (location) of the file.
  • In the next 2 cells we define what are the starting cell and the ending cell that contains our data.
  • Next we are put the name of the worksheet where the data will be pasted. In our example the sheet remains the same however as per your requirements you may put a different sheet name.
  • The last option is to specify where to paste the copied data and we only need to tell the start cell address, the code will automatically select the next empty cell in that column and then paste the data from that point onwards.

 

Let’s understand the code.

Sub GetData()
Dim strWhereToCopy As String, strStartCellColName As String
Dim strListSheet As StringstrListSheet = “List”

On Error GoTo ErrH
Sheets(strListSheet).Select
Range(“B2”).Select

‘this is the main loop, we will open the files one by one and copy their data into the masterdata sheet
Set currentWB = ActiveWorkbook
Do While ActiveCell.Value <> “”

strFileName = ActiveCell.Offset(0, 1) & ActiveCell.Value
strCopyRange = ActiveCell.Offset(0, 2) & “:” & ActiveCell.Offset(0, 3)
strWhereToCopy = ActiveCell.Offset(0, 4).Value
strStartCellColName = Mid(ActiveCell.Offset(0, 5), 2, 1)

Application.Workbooks.Open strFileName, UpdateLinks:=False, ReadOnly:=True
Set dataWB = ActiveWorkbook

Range(strCopyRange).Select
Selection.Copy

currentWB.Activate
Sheets(strWhereToCopy).Select
lastRow = LastRowInOneColumn(strStartCellColName)
Cells(lastRow + 1, 1).Select

Selection.PasteSpecial xlPasteValues, xlPasteSpecialOperationNone
Application.CutCopyMode = False
dataWB.Close False
Sheets(strListSheet).Select
ActiveCell.Offset(1, 0).Select
Loop
Exit Sub

ErrH:
MsgBox “It seems some file was missing. The data copy operation is not complete.”
Exit Sub
End Sub

We have used the Workbook object to accomplish this task and also the Error handler to trap any errors that may come in case any file is missing.

The current code will display a message box when it is not able to open any file and will stop.

We start by assigning the workbook where we want to consolidate the date to the variable currentWB by using the statement:

Set currentWB = ActiveWorkbook

After this a looping construct has been used to go through all the inputs provided one by one and open the workbooks, it has been assumed these workbooks to contain on the data that we need to copy hence I did not specify the source sheet name, however this can be easily added to this code to add more functionality.

Inside our loop are the 4 variables which are assigned the
1) File name,
2) Copy Range,
3) Where To Copy and
4) Which Column contains the starting cell to paste data.

We open the data workbook by using the Application.Workbooks.Open method.
Once we have our first data workbook open, we assign this to the dataWB variable so that we can easily switch between the two workbooks and close them when the operation has been completed.

Next we select the data that has been assigned to the copy range and copy to the clipboard.

We then switch back to our main workbook and select the sheet where we want to paste the data, I have assigned this to the variable called “strWhereToCopy”. This allows us to paste data onto separate sheets within the same workbook.

I have also made use of UDF (user defined function) to find the last cell in the column that we specify.

Once we have found the last row we then select the next empty cell below that and paste our data then.

Additional things that may be used to enhance this code

1. Since we are using the same instance of Excel we may allow the user to preserve the format of the data being pasted.
2. Allow the user with the option to clear data before new is pasted.

Download Consolidate Data from different files Demo file

Click here to download the workbook.

Please Note: You would need to create the data files on your system, this download only contains the code template to consolidate.

More on VBA & Macros

If you are new to VBA, Excel macros, go thru these links to learn more.

Join our VBA Classes

If you want to learn how to develop applications like these and more, please consider joining our VBA Classes. It is a step-by-step program designed to teach you all concepts of VBA so that you can automate & simplify your work.

Click here to learn more about VBA Classes & join us.

Facebook
Twitter
LinkedIn

Share this tip with your colleagues

Excel and Power BI tips - Chandoo.org Newsletter

Get FREE Excel + Power BI Tips

Simple, fun and useful emails, once per week.

Learn & be awesome.

Welcome to Chandoo.org

Thank you so much for visiting. My aim is to make you awesome in Excel & Power BI. I do this by sharing videos, tips, examples and downloads on this website. There are more than 1,000 pages with all things Excel, Power BI, Dashboards & VBA here. Go ahead and spend few minutes to be AWESOME.

Read my storyFREE Excel tips book

Overall I learned a lot and I thought you did a great job of explaining how to do things. This will definitely elevate my reporting in the future.
Rebekah S
Reporting Analyst
Excel formula list - 100+ examples and howto guide for you

From simple to complex, there is a formula for every occasion. Check out the list now.

Calendars, invoices, trackers and much more. All free, fun and fantastic.

Advanced Pivot Table tricks

Power Query, Data model, DAX, Filters, Slicers, Conditional formats and beautiful charts. It's all here.

Still on fence about Power BI? In this getting started guide, learn what is Power BI, how to get it and how to create your first report from scratch.

65 Responses to “Make Dynamic Dashboards using Pivot Tables & Slicers [Video & Download]”

  1. claudia says:

    WOW, is all I can say.

    I could not have imagined a dynamic dashboard without getting approved software budget and a team of people involved to create it. Given that I am a relative newbie to excel and actually got here by looking for pivit table help, I imagine that i would not be able to make anything myself. But armed with the demo excel sheet I will press buttons (and I will report back how that went;-)

    Claudia

  2. winston says:

    Good stuff Chandoo, thanks
    The slicer buttons take up quite a bit of room on the dashboard
    Is there a way to make the buttons smaller so we can have more room for charts, tables, and commentary?

    Kind regards,
    Winston

    • Jova says:

      You can resize the slicers! When you click the slicers you can change the height and width of columns and slicers. You can also, under slicer style click "New slicer style" where you can define your own style, which enables you to change most things, including font size.

  3. Gregory says:

    I hadn't seen the Group Option used as you did for the Duration PivotTable. And thanks for showing how to remove the Field Buttons on a PivotChart, I loathe them with all my heart.

    Fantastic design and a great dashboard.

  4. Chandoo says:

    @Claudia.. I am glad you like it. Do let us know how your adventures go.

    @Winston: You can resize slicers or increase the number of columns inside. Unfortunately, we can not readjust the font sizes in slicers. So when you resize, you will see partial text.

    @Gregory: Thank you. I am happy you like it 🙂

    • kris says:

      Hi Chandoo, your dashboards are really professional and simple. I do have some question, if I have the following scenario, could you help to advise : -different data sources eg monthly
      -calculations percentile
      -%difference between financial year

      Thank you so much!

  5. Divya says:

    Hi,

    Thanks for your great information.It has helped me a lot.
    Now,I can build my excel addin for Excel 2010 better with your tips.

  6. Istiyak says:

    Hi chandoo i am new reader for ur site.and really found good stuff and temp. But i suggest u 2 put a guidance step sheet in temp so anyone can understand easily.and also help me to become awesome as ur noume.

  7. Stevros says:

    Chandoo, Wow these are very powerful reports. I will be implementing them straight away. It will save me hours of work. Thankyou so much.

  8. Paul Avenell says:

    Hi Chandoo,

    I love the Slicer, but how do I link a slicer for different data sheets e.g.: Client data on one tab and products on another tab, as I find that as long as you use pivot tables off the same data you can link the Pivot tables using Slicer connections.

    Regards
    Paul

  9. Vivek says:

    I appreciate the work you have posted on your website - very informative and easy to understand. I just wanted to inform you that you can make selections within the slicer too by using Ctrl and selecting the fields you want to group and use as filter.

    I had a question regarding the data used in pivot tables. Is there a way to update the data (eg. a new customer entry) and have the pivot tables and the linked charts in dashboard automatically update? I will search for the answer in other posts so ignore if you have covered it elsewhere.

    Thanks again and keep up the good work.

    -Vivek

  10. Brij Arora says:

    Dear All,

    Me too is a die hard fan of Slicer. it's requirement was arise when management is feeling it difficult to juggle with filters for sales of a particular location, Product Category in Pivot Table.

    Got very positive response when introduced to tackle the above situation. furthermore in slicer setting there would be option to enable or disable deleted data is handy for particular scenario.

    These are eye catching color themes would be like icing on the cake.

    There is one more feature of excel 2010 which proves to be tool for great time saving is "Repeat Labels" in Pivot Tables.

  11. Katherine says:

    This is fantastic!! Your steps were super to easy follow. I can't wait to show my new dashboard off to the boss. Thank you so much!

  12. Van says:

    This might be a little unrelated but I'd like to know which software was used to record your on screen actions? I'd like to use it for tutorials on models that I build for my customers. Thanks!

  13. DV says:

    The slicers are coming in a sorted order... How can i get it in the way it appears in my original data.... The settings show to sort them A to Z or the other way round but they are option boxes and can not be unchecked... What are my options????

  14. Duncan Williamson says:

    I watched the video and then worked through an example of my own, also telephone costs by coincidence. It took me about 30 minutes to do everything. Once you've understood the basics of pivot tables and slicers, all that limits you is your imagination!

    The only thing missing from the video is now to change the number of columns in a slicer: Right click a slicer then Size and Properties, Position and Layout, Layout, Number of Columns ...

    Good page and video.

    Duncan 

  15. soycharnichart says:

    How do you insert 'Year' in the Pivot Table Field List if it doesnt exist in the Master table???

    Thanks 

  16. Manu says:

    Hi,

    Can I disable the multi-selection of the slicer to only allow one selection at a time?

    Thanks in Advance    

    • Chandoo says:

      @Manu.. as of Excel 2013, this is not supported yet. But you can remove slicer heading, clear filter button and style it so that it looks like a single selection. You can also use Macros to ignore previous selection upon multiple selection, but I would not recommend it.

      For an example on styling see - Interactive Pivot Calendar

  17. Devin says:

    Awesome guide!  The dashboard I made blew people away.  I do have one question.  I want the chart title to match what I have selected.  How can I do this without writing macros?

    • Hui... says:

      @Devin
      Lets say what you have selected in in A1
      Select the Chart then Select the Title
      Click in the Formula Bar and type =A1
      enter or click the small arrow to the left of the Formula Bar
      Enjoy

  18. Johnny says:

    Love the slicers and use them often in my dashboards.  Question about the data (specifically the date)  I see the "date of call" column but was wondering how were you able to filter on slicers by year and month when there is only a date of call entered into the data?

    Thanks for your help! 

  19. Jet Copeland says:

    Thanks for taking the time to create this interesting and very useful tutorial!
    I was able to create a similar dashboard in a short time after watching your tutorial. The problem I am having now is how to update the pivot tables and dashboard graphs when a change is made in the raw data. I tried two methods; Change data Source and Refresh. When I used Change Data Source (Options-> Change data source) the values in the pivot tables didn't update. When I tried refresh the values in the pivot tables disappeared as well as the information in the graphs, since the data in the pivot tables no longer existed.
    I have been searching for a solution for a while now but I have unfortunately not been able to solve this problem yet. Any help someone can provide is GREATLY appreciated.
    All the best 

  20. Nigel says:

    Hi, looks great, but how valuable is power view when it comes to financial data? I've been having trouble trying to visualize how I would use power view to report of financial data.

  21. Snooky says:

    Hi Chandoo, you are awesome! Thanks for the good work!

  22. beth says:

    there is duplication for my slicer, probably cause i choose date, time as my options. i changed it to date but still theres a duplication of the same date

  23. Alex Cardoso says:

    Just Great! Thank you for the time to put this together and teach us.

    Alex Cardoso from Indaiatuba, Brazil.

  24. jose says:

    First of all I would like to thank you guys for this post I used this amazing tool with the help of your tutorial to create a dashboard for one single account and my regional manager said "good job, it looks very profesional" she was so impresed that now she wants one daschboard with all the acounts and services she is going to replace her KPI reports with my report !! I smell a promotion!! My demand was a new laptop with MS 2010 and it was granted. now I have allot of work and many many questions to post .. kudos

  25. krishna prasad says:

    Hi Chandoo

    I want to say thanks first because i loved ur tutorials

    i have a small doubt how to insert slicer from external connections

    i searched every where could you please explain how to insert a slicer from external source

  26. Jyothi says:

    Hello Chandoo,

    How to get rid of the > items in Months slicer?

    They are appearing when there is a grouping on the date field in pivot

    Thanks

  27. Emma says:

    Hi Chandoo,

    One problem always bothers me when i use slicer. I have no idea aobut how to change the number format in slicer. Want to display number in slicer as general format, but it always displays other number format such as date.
    I check my source data and it doesn't effect the number format.

    Look forward you or any EXPERTS to solve it. Thanks very much!

    In the end, This website is awesome!!!

    • Sunil says:

      Hi Emma,

      Were you able to resolve your query? I have a similar problem. I use Excel 2013 and the field I'm dropping into the slicer is a currency field ($1.00, $1.05, $1.10 etc.) representing the exchange rates that the user can choose from. The items in the slicer revert back to general format (1, 1.05, 1.1, etc.) although the source field is formatted as currency field. Is there a way to fix this?

      • Chandoo says:

        @Sunil & Emma: You can create a new column in your raw data which has currency as text, using the TEXT formula like this =TEXT(currency_val, "$#,##.00"). Use this column to create the slicer.

        • Sunil says:

          Thanks for the response Chandoo. It works as you suggested. However, if the users were to pick more than one item in the window I'd like to know what is the max value and utilise that value in a DAX formula.
          Also... there is no issue if I were to throw a slicer over a normal pivot. The trouble comes when I choose the 'Add this data to the Data Model' option which I need for the PowerPivot.

  28. Jonas says:

    Hi Chandoo (Or others)

    Is there a way to make the color change, when the value changing after the use of a slicer?

    Lets say the value is 4,5, when i press the slicer, and the value change to 3,5 i would like the color to change. Can anyone help?

    Thank you.

  29. Burendei says:

    Hi Chandoo,

    It was very useful video for me. Thanks.
    But I have one question to ask.
    How can I connect data which is growing in size (rows, records) by time (daily, monthly etc.) to this kind of dashboard?
    Or it is only on select number of data?

    Thank you.

  30. Angela says:

    Chandoo zindabad!

  31. Angela says:

    Hi Chandoo,
    I have been able to create something similar quite easily. The problem that I am facing is that I want to keep the Top 10 filters permanently. If I select one option and then clear the filter, the chart removes the Top 10 filter; I want it to go back to Top 10 filter.

    Is there a solution to this problem?
    Regards

    • Federico says:

      Thanks a lot for the tutorial and for the demo file!
      I have the same problem of Angela: after clearing the filter applyed on P1, the filter on P1 shows all the customers without filtering top 10 (as it was before).
      Thanks!

      Federico

      • Justin says:

        Go to your pivot table, right-click and choose "pivot table options." On the "Totals & Filters" tab check "Allow multiple filters per field."

        • Federico says:

          Justin, thank you so much!
          now after clearing the filter applyed on P1, the filter on P1 shows again top 10 customers.

  32. Roger says:

    Chandoo!
    Just find out your website, I´ll follow your tutorials from now, very useful!
    Great thanks from Brazil!!!

  33. Priya Ranjan says:

    Very useful. Learned a new skill today. Thanks a ton!

  34. Manav says:

    Hi Chandoo,

    This is fantastic! It's going to really help me with some operational reports I develop regularly. Two questions I'm hoping you can answer for me:

    1. How can I use one slicer to manipulate two different pivot charts that came from two different pivot tables?
    2. If I have a slicer in an excel and share that with someone who is on older versions of Excel - what will it look like to them?

    thanks!

  35. Elisa says:

    Hello Chandoo!
    I love the dashboards and have been able to make quite a few, my puzzle is when I am connecting the pivot charts to the slicers, I have to do each individual one and check every single slicer (usually I have about 12, so I end up having to check the 12 check boxes 12 times to connect everything) am I missing something? Is there an easier way to do this?

    Thanks!
    elisa

  36. Hama says:

    Hello Chandoo,

    You make my life easier, am in love withe the slicers!

    I greatly appreciate

    Thanx

    Hama

  37. […] Slicers.  Easy for me to do, but not as easy to explain how I did it.  Fortunately, Chandoo has a Make Dynamic Dashboards using Pivot Tables & Slicers video and download that will do the job nicely.  Suffice it to say it took me <3 minutes to put […]

  38. @jitkumar56 says:

    thank you very much..... 🙂

  39. Jimbo says:

    You are a legend!! Thank you so much - very clear, very helpful indeed.

  40. Shahid says:

    nice player...

    i like to play like chandoo sir.

    i learn somthing about slicer by watching posts.

    it was too difficult to watch and easy to prepare..

    thank you boss.

    God Bless You

  41. MFAC93 says:

    Hi,

    I've built a dashboard on Excel 2010 using Pivot tables and slicers.

    What I would like to do now is duplicate the dashboard on another tab, having it extract from another data source (format is identical to the 1st data source).

    I'm extracting the same metrics, but each data sources measure different product lines.

    Could anyone help me out?

    Thanks in advance,
    M

  42. Vicky says:

    Thank you so much. I learned so much about the slicer because of the video. Just got a quick question. Say I got 100+ Customer name bottons in one of the slicer, and it is time consuming to scroll up and down to find the one to select. Is there anyway I can set in the slicer setting that when I type "E", it automatically take the selectionto to where all the "E" starts? Thanks

  43. TL says:

    Hi there,

    This looks great - is there a way I can use it to compare vs budget, forecast? Is it just a case of renaming one of the field Comparison with the data being "Actual, Budget, Forecast"?

    Thanks!

  44. an irany says:

    hello master!
    please help me.
    i am looking for many file example for Dashboard, but because my English is weak i couldnt fint it in hear.
    please help me.
    thankyou so much.

  45. Ikram Siddiqui says:

    Dear Excel Guru,

    Hope everything is fine with you?

    Can you please help in this Logic, it is a thought only to increase my knowledge SIR?

    Please note that I have been working in Excel file contains two times of our teammates who claims overtime an each calendar month

    My excel file as like this :-

    ROW 1 Days of Month
    ROW 2 Date of Month

    Cell -1 [Time IN(06:00Hrs)], cell -2 [Time OUT(15:30Hrs)] no break in our factory and anything after Eight hours assume as overtime as standard in all across.

    Appreciate if you could help me in providing the best an Exclusive Excel formula to calculate each day overtime excluding staff eight hours regular duty and Friday consider as full day overtime.

    Kindly help me at the earliest convenience.

    awaiting for your expertise.............

    Best Regards / Ikram Siddiqui

  46. Lav Mishra says:

    Thank you for video , will you please provide pivot table with header and sub header like year main header and under that three sub header. How to make dashboard for that.

  47. Praful Patil says:

    Dear Sir,

    How to seperate amount, mention in remarks.

Leave a Reply