PDA

View Full Version : Perlfect Search only indexed 3 files!



RedBall
12-12-2006, 11:18 AM
I just installed Perlfect Search, and it only indexed 3 files. I have plenty of ordinary HTML files on the top level of my account that it skipped. How come? Also, is it supposed to index files that are inside directories by default? I have plenty more HTML files in directories that it also skipped.

rolling
12-12-2006, 05:37 PM
From the perlfect (http://www.perlfect.com/freescripts/search/faq.shtml#T10) website.


If you are indexing your local filesystem check the values of @EXT in /var/www/html/cgi-bin/search/conf.pl and the entries in /var/www/html/cgi-bin/search/conf/no_index.txt. If you make changes to those values, you will have to run indexer.pl again. If you are indexing via http, check the following list:

* Perlfect Search only follows links, it does not try to submit forms. So every automatically generated page that should be indexed needs to be accessible via a common link.
* Remember that the script will only find files that are directly or indirectly linked from your start page ($HTTP_START_URL).
* If you have pages which are only accessible with Cookies, Java, Javascript, Flash etc enabled, these will not be indexed either. This is not a bug in Perlfect Search but a general problem that other search engines have too. You'll have to rework your pages to also work without Cookies/Java/Javascript/Flash.
* Framesets need a proper <noframes> section with correct links.

* If all that does not help, check the values of @HTTP_CONTENT_TYPES and $HTTP_LIMIT_URL and turn on $HTTP_DEBUG to get more debugging output during indexing.

It's basically a robot that starts at /var/www/html/index.html and works its way from there, following any links it finds.