• Hi All

    Please note that at the Chandoo.org Forums there is Zero Tolerance to Spam

    Post Spam and you Will Be Deleted as a User

    Hui...

  • When starting a new post, to receive a quicker and more targeted answer, Please include a sample file in the initial post.

Creating a dashboard from large volume of data

H

Hiren Parekh

New Member
We need to create a dashboard to display specific client data from a database that has around 70 million records. The data cannot be grouped.

The method of using a SQL connection is very slow. The end user has to search for the client using the name and DOB from a list that is visible when a search is done.

Is there a way to only bring in records via the SQL query for a particular client based on the end user input that is faster than going thru the whole SQL database?

Please advise.

Thank you.
 
Few things you can try.
1. Incremental load
2. Set data load from db to occur only on schedule and during off peak hours
3. Split data into smaller chunks and publish in separate reports

Once data is loaded to the model. Returning result from within model is near instantaneous.
 
You must log in or register to reply here.
Back
Top