SQL Power Business Intelligence Productivity Tools

SQL Power Software Forum

SQL Power Software Forum

  [Search] Search   [Recent Topics] Recent Topics   [Hottest Topics] Hottest Topics   [Members]  Member Listing   [Groups] Back to home page  [Register] Register /  [Login] Login 
Match Maker - Number of records in the matching table  XML
Forum Index » SQL Power DQguru Discussion
Author Message
lilihammer


Joined: 2007-06-07 14:18:48
Messages: 101
Offline

OS: Windows
Version: 0.9.3

I was trying to run match maker a de-duping project on a table with 147K records. It takes the engine more then 6 hours to be able to complete.

Another run on a different table with about 60K records takes over 4 hours.
What is the capacity match maker should be able to run at?
Jeff
SQL Power Developer
[Avatar]

Joined: 2007-06-27 18:31:33
Messages: 410
Offline

I think there are more factors involved than just number of records. For example, I was working on a possible optimization of the engine, and when testing the original algorithm on a 100k row table, it took less than 15 minutes. Mind you this was on a locally-hosted database. Also, the number of matches your munge process results in will also affect the result. Generally, the more matches found, the longer it will take.

-Jeff
spiderjutt


Joined: 2015-02-27 07:52:06
Messages: 1
Offline

. It takes the engine more then 6 hours to be able to complete. ?
 
Forum Index » SQL Power DQguru Discussion
Go to:   
Powered by JForum 2.1.8 © JForum Team