Splitting an Excel file in to many is easier than splitting bill in a restaurant among friends. All you need is advanced filters, a few lines of VBA code and some data. You can go splitting in no time.
Context:
Lets say you have lots of data like this in a file. And you want to split this in to multiple files, one per salesperson.
Solution – Split Data in to Multiple Files using Advanced Filters & VBA
The process of splitting data can be broken down to 4 steps.
- Identify the split criteria and list down all values in a small range. In our case, we list all the salespersons names in a named range lstSalesman.
- Set up advanced filters so that we can filter the data by one salesman at a time.
- Now, for each salesman, apply advanced filters and set it to copy the filtered values elsewhere.
- Copy the filtered values
- Add a new workbook and paste the copied values there.
- Save the new workbook with a unique name
- Repeat the above 3 steps for each salesman
- That is all! You are done splitting.
Video Lesson on Splitting Data using Filters & VBA
Since splitting data in to multiple files requires a bit of macro code & advanced filter knowledge, I have created a short lesson explaining how this works. Watch it below.
[If you are not able to see the video, watch it on our Youtube Channel]
If you are new to VBA, take our crash course.
Download Split Data Example Workbook
Click here to download the split data example workbook.To use this,
- Save the downloaded file to any folder.
- Open the file and enable macros.
- Examine everything and when ready, click on “Extract” button.
- Check the folder where you saved the file and you will fine 4 new Excel workbooks named after the salespersons with the data extracted for them.
You can find the macro code in Module 1.
How do you Handle Splitting Situations?
In my work, I rarely had to split data. And whenever I had to split data, I usually copy paste the data after filtering what I want. But I can imagine many real life scenarios where you need to automate the splitting part.
How do you split data? What techniques and ideas you use to speed up the splitting process? Please share using comments.
More on Splitting & Consolidation
If you are in to splitting or combining things, we have a selection of tips & examples to help you. Check out these articles.
- Consolidating Data in Excel – a collection of techniques & tips
- Split Text on new line using VBA
- Combining Data using Excel’s Consolidate Feature
- Using 3D References to Consolidate Data
PS: Heck, we have even have an Excel tip to tell you how to split expenses among friends 😛
PPS: You can use Pivot Table Report Filters if you want to split data in to multiple sheets.
8 Responses to “Pivot Tables from large data-sets – 5 examples”
Do you have links to any sites that can provide free, large, test data sets. Both large in diversity and large in total number of rows.
Good question Ron. I suggest checking out kaggle.com, data.world or create your own with randbetween(). You can also get a complex business data-set from Microsoft Power BI website. It is contoso retail data.
Hi Chandoo,
I work with large data sets all the time (80-200MB files with 100Ks of rows and 20-40 columns) and I've taken a few steps to reduce the size (20-60MB) so they can better shared and work more quickly. These steps include: creating custom calculations in the pivot instead of having additional data columns, deleting the data tab and saving as an xlsb. I've even tried indexmatch instead of vlookup--although I'm not sure that saved much. Are there any other tricks to further reduce the file size? thanks, Steve
Hi Steve,
Good tips on how to reduce the file size and / or process time. Another thing I would definitely try is to use Data Model to load the data rather than keep it in the file. You would be,
1. connect to source data file thru Power Query
2. filter away any columns / rows that are not needed
3. load the data to model
4. make pivots from it
This would reduce the file size while providing all the answers you need.
Give it a try. See this video for some help - https://www.youtube.com/watch?v=5u7bpysO3FQ
Normally when Excel processes data it utilizes all four cores on a processor. Is it true that Excel reduces to only using two cores When calculating tables? Same issue if there were two cores present, it would reduce to one in a table?
I ask because, I have personally noticed when i use tables the data is much slower than if I would have filtered it. I like tables for obvious reasons when working with datasets. Is this true.
John:
I don't know if it is true that Excel Table processing only uses 2 threads/cores, but it is entirely possible. The program has to be enabled to handle multiple parallel threads. Excel Lists/Tables were added long ago, at a time when 2 processes was a reasonable upper limit. And, it could be that there simply is no way to program table processing to use more than 2 threads at a time...
When I've got a large data set, I will set my Excel priority to High thru Task Manager to allow it to use more available processing. Never use RealTime priority or you're completely locked up until Excel finishes.
That is a good tip Jen...