Interesting product, might want to check it out: phpDig. Let's you create a reasonably powerful site search.

Note, don't use the indexing component on shared servers as a rule because it will time out and is also very processor intensive.

There's some good hints on how to get around that type of problem however at linux.com.

Basically, the idea is to have a home development server that does the spidering, and where you control the php.ini to change some settings, like server time out etc. This will let you spider the site, create the database, then all you have to do to have your live site searchable locally is to upload the db to your live site.
Back to top