Lord

V2.6 Help, If you need help and cannot find it in the FAQ area of this forum feel free to ask the question and someone will reply back.

Moderators: webmaster, Christian, Kuok-Tim, ChrisClark, Forum Support

Lord

Postby jamesp » Wed Apr 15, 2009 3:09 pm

If I do a keyword search on 'lord' - it finds songs with the word 'lords' in them, but if a song contains 'lord' but not 'lords' it gets missed.
jamesp
Intermediate
 
Posts: 30
Joined: Mon Oct 03, 2005 7:26 am

Re: Lord

Postby brainier » Tue Apr 21, 2009 1:57 pm

So it does - an I have other examples of words that do not appear when searched for, so I thought I would do a little research. If I search for "lord" or "lords" I get 41 results on my copy of the database. Searching for "jesus" gives 863 results.

I opened the database in Turbo DB Viewer (search Google for this) and updated the full-text index (in viewer I opened MainTable, Table menu > Create full-text index). One of the questions asked during this process was what is the upper limit for keywords that occur too often. The Turbo DB Viewer set this to 1000 (note that this is greater than the 863 for "jesus"). I set this value to 9999 and build a new full-text index. I reopened Zionworx and now searched for "lord". I got 1286 results. I suspect that Zionworx has the same upper limit and this ought to be increased in the next update of the product - say maybe 2 or 3 thousand. There cannot be many words that turn up that often, but given that the database product does not index them rather than returning a "too many" error is not consistent with general users experience of search engines. It ought, but it would seem to be outside the scope of the database engine used, to say "here is 1000 results for 'lord', please redefine your query".

To finish my test, I rebuilt the index and stopped at 500 repeated words. This time a search for "jesus" found 1 result - a song with the word "jesus-" in it! So, a recommendation and a workaround.

Recommendation: Increase the search frequency count in the full-text index to a few thousand or add this to the .ini file to allow different churches to decided on own what they want (as increasing beyond current values might slow the indexing down on very large song databases with slow computers)

Workaround: Download Turbo DB Viewer and build your own index and not use the index updater in Zionworx. Zionworx comes with a file called KeywordExclude.txt which should be used during the index generation program (and of course check that this file does not contain the word "lord" as well).
Brian Reid
Woodstock Road Baptist Church, Oxford, UK
http://wrbc.org.uk/
brainier
Expert User
 
Posts: 325
Joined: Sun Oct 02, 2005 7:51 pm
Location: Oxford, UK.

Re: Lord

Postby brainier » Tue Apr 21, 2009 2:15 pm

A few additional notes to make on this subject - I have a two year old, fast laptop, and searching for "lord" is visibly slower than (say) "jesus". So the extra (in my case) 500 instances of the word have an impact.

And of course, when I suggest increasing the search frequency to 2000 or 3000 per word, I have a song database with 2500 songs and the results in the above post are the number of returned songs and not the number of times the word was found (which I think I might have implied).
Brian Reid
Woodstock Road Baptist Church, Oxford, UK
http://wrbc.org.uk/
brainier
Expert User
 
Posts: 325
Joined: Sun Oct 02, 2005 7:51 pm
Location: Oxford, UK.

Re: Lord

Postby brainier » Tue Apr 21, 2009 6:51 pm

A later test on the church computer - which is considerably slower than my laptop showed no difference (afaik) in searching for Lord once I rebuilt the index in Turbo DB Viewer.

But an interesting resutl turned up for combined searches. I have over 400 songs that contain the words "lord" and "jesus". So if I search for "lord jesus" I should get these 400 results - but I do not. With the default index setting which does not index words that are too frequent it removes "lord" from the index and so returns 15 results - this must be those 41 songs that are "lords" that also contain "jesus"!

So a cross posting in the Wishlist forum is needed as this really does need changing.
Brian Reid
Woodstock Road Baptist Church, Oxford, UK
http://wrbc.org.uk/
brainier
Expert User
 
Posts: 325
Joined: Sun Oct 02, 2005 7:51 pm
Location: Oxford, UK.

Re: Lord

Postby Jonathan Hills » Tue Apr 21, 2009 10:02 pm

brainier wrote:Workaround: Download Turbo DB Viewer and build your own index and not use the index updater in Zionworx.

I follow this bit

brainier wrote:Zionworx comes with a file called KeywordExclude.txt which should be used during the index generation program (and of course check that this file does not contain the word "lord" as well).

Not sure how to execute this bit, how do you use this txt file during indexation?
Jonathan Hills
Most Senior
 
Posts: 111
Joined: Sun Jan 29, 2006 9:32 pm
Location: Colchester Essex

Re: Lord

Postby brainier » Wed Apr 22, 2009 9:18 am

During the index wizard steps (on the page which asks for the upper limit for frequency) you are asked for a meaningless words list. You enter (or browse to) the above file (in program files\zionworx) and then the index generation process will ignore words such as "the" which now might appear within your frequency paramaters, but need not be searched for.
Brian Reid
Woodstock Road Baptist Church, Oxford, UK
http://wrbc.org.uk/
brainier
Expert User
 
Posts: 325
Joined: Sun Oct 02, 2005 7:51 pm
Location: Oxford, UK.

Re: Lord

Postby brainier » Sat Dec 19, 2009 11:10 am

The latest version of Zionworx (v2.6.52) fixes this issue. I can now search for "lord" and get 1295 results and "lords" and get a different number.

Upon installing the latest version you need to do an "Update full text index" from the Database menu before the new results count feature works.
Brian Reid
Woodstock Road Baptist Church, Oxford, UK
http://wrbc.org.uk/
brainier
Expert User
 
Posts: 325
Joined: Sun Oct 02, 2005 7:51 pm
Location: Oxford, UK.


Return to Zionworx V2.6 Support

Who is online

Users browsing this forum: No registered users and 3 guests

cron