Database Query Search Time

[green-watch.org]

Hey Guys,

This post will explain how to setup an extremely simple DataImportHandler for SOLR using a MS SQL Server 2005 database.

First, you will need to add some code to the solrconfig.xml file as follows:

Code:

<requestHandler name="/dataimport" class="org.apache.solr.handler.dataimport.DataImportHandler">
  <lst name="defaults">
    <str name="config">F:\collections\products_id8\conf\data-config.xml</str>
  </lst>
</requestHandler>

The data-config.xml will be exactly as follows:

Code:

<?xml version="1.0" encoding="UTF-8" ?>
<dataConfig>
  <dataSource type="JdbcDataSource" name="GreenEarth3" driver="com.microsoft.sqlserver.jdbc.SQLServerDriver"
  url="jdbc:sqlserver://localhost;databaseName=myDSNName;responseBuffering=adaptive;" user="myUsername" password="myPassword" />
  <document name="products">
    <entity name="myProduct" dataSource="myDSNName" pk="PRODUCT_ID" query="SELECT PRODUCT_ID FROM TESTPRODUCT">
      <field column="PRODUCT_ID" name="PRODUCT_ID" />        
    </entity>      
  </document>
</dataConfig>

In the schema.xml file, I have the <fields> section as follows:

Code:

<fields>
  <field name="PRODUCT_ID" type="integer" indexed="true" stored="true" required="true" />
  <field name="contents" type="text" indexed="true" stored="false" required="false" multiValued="true" omitNorms="true" />
</fields>

<uniqueKey>PRODUCT_ID</uniqueKey>

You will also need to get a copy of the JAR file found here:
http://www.microsoft.com/downloads/en/de...66235EFC7C

The sqljdbc.jar file must be placed in "C:\ColdFusion9\solr\lib" or wherever you installed SOLR on your server.

After you set all of this up, I suggest going here on your server:
http://localhost:8983/solr/COLLECTION_NAME/admin/dataimport.jsp

From there, you can do full imports, delta imports, and much more.

Once I explore this a bit more, I will talk about delta imports and some other advanced stuff. It will be interesting to see how much faster all of the information can be indexed using this method.

Sincerely,
Travis Walters