Current time: 01-22-2021, 10:17 PM Hello There, Guest! (LoginRegister)

Post Reply 
 
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Database Query Search Time
08-25-2010, 01:05 AM
Post: #42
RE: Database Query Search Time
Greetings Anthony,

When I started having my maxWarmingSearchers problem, I actually came across your post on coldfusionjedi. I purged my collection and then reindexed it all over again like you did. It worked great at first and the reason why is because data takes less time to index with smaller collections.

Indexing takes longer as a SOLR collection grows larger. With my first indexing attempt, my script started executing while another one was already in progress. That really bogged down the server and things got messed up rather quickly. At that point, I created a variable in my GLOBAL table that checked to see if the indexing script was already in progress before executing the indexing code again. Having said that, even if the variable indicated the code is not currently executing, it took some time before the number of files got recognized by the coldfusion collection. I think there is some sort of "commit" bug if files get indexed too quickly.

You might want to revisit the bulk insert concept. If you have actual files, you can use CFFILE to read the content into a variable, and then use that variable to create a CFQUERY row. Once you have the CFQUERY created, you can pass that to the CFINDEX to do the bulk insert.

I wish I could see what goes on under the hood of CFINDEX. I am sure it would be possible to create a custom function like i did for the CFSEARCH function.

By the way, if you want to post some example indexing code, I can take a glance at it on here and see if I have any suggestions.

Sincerely,
Travis Walters
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Database Query Search Time - pmeenan - 07-04-2010, 12:03 PM
RE: Database Query Search Time - pmeenan - 07-05-2010, 04:35 AM
RE: Database Query Search Time - sajal - 07-05-2010, 05:03 AM
RE: Database Query Search Time - pmeenan - 07-08-2010, 08:47 PM
RE: Database Query Search Time - sajal - 08-13-2010, 10:06 PM
RE: Database Query Search Time - sajal - 08-14-2010, 03:38 AM
RE: Database Query Search Time - sajal - 08-14-2010, 06:50 AM
RE: Database Query Search Time - pmeenan - 08-16-2010, 02:55 AM
RE: Database Query Search Time - sajal - 08-17-2010, 01:14 AM
RE: Database Query Search Time - pmeenan - 08-23-2010, 01:22 AM
RE: Database Query Search Time - pmeenan - 08-23-2010, 08:45 PM
RE: Database Query Search Time - ringman57 - 08-24-2010, 11:52 PM
RE: Database Query Search Time - green-watch.org - 08-25-2010 01:05 AM
RE: Database Query Search Time - ringman57 - 08-25-2010, 02:54 AM

Forum Jump:


User(s) browsing this thread: 1 Guest(s)