ExternalSiteCatalog

ExternalSiteCatalog allows you to index and search external sites in a Plone site.
Download

ExternalSiteCatalog Ranking & Summary

Advertisement

  • Rating:
  • License:
  • GPL
  • Price:
  • FREE
  • Publisher Name:
  • Ingeniweb
  • Publisher web site:
  • http://www.ingeniweb.com

ExternalSiteCatalog Tags


ExternalSiteCatalog Description

ExternalSiteCatalog allows you to index and search external sites in a Plone site. ExternalSiteCatalog allows you to index and search external sites in a Plone site.ExternalSiteCatalog is a web crawler that can index external sites and make them searchable in Plone. You can specify the sites to index in a Plone Configlet, and directly index them from Plone, or let a scheduler do the job. Have a look at some of the screenshot in the doc folder of the product to get a first impression of what it looks like. Searching the external sites is done in a special portlet that is installed with ExternalSiteCatalog. External sites are not searchable in the normal Plone catalog, but are only available in a separate catalog in the portal_externalcatalog tool. Direct indexingAll external sites are configured in the ExternalSiteCatalog configlet.If you want to index external sites immediately, you can do so afterdefining all the parameters, selecting your site, and clicking onthe "index" button in the configlet. Crawling external sites regularlyIf you want external sites to be crawled regularly every day or month,you'll have to do some extra work. Make sure to install PloneMaintenancestarting from version 1.3. Make sure that you are also regularly callingPloneMaintenance from cron or one of the Zope schedulers. Follow the installation instructions in PloneMaintenance! Have a look at the portal_maintenance tool in the Zope Managementinterface! It contains a lot of useful information! Console indexing utility The console indexing utility is a bit more complicated than doing everythingfrom Plone. In many cases you don't have the resources to administrate anexternal utility, but if you can afford it, this tool gives you the possibilityto decouple the long running work of fetching external sites from Zope.Basically, you can be sure that there is no Zope thread blocked with crawling external sites for a long time. Zope is only called from the externaltool when it should index a page, so there is still some load on theZope server!Please note that this external tool is not making use of the information entered in the Plone configlet. It is completely independent! It also doesnot make use of PloneMaintenance, and it is up to you to configure and call it with a scheduler like cron.Requirements:· Zope 2.7+· PloneMaintenance 1.3What's New in This Release:· Included and excluded urls can now be configured in the configlet using regular expressions. This is extremely useful if you want to include only pages starting under a certain folder. The regular expression for inclusion of the "docs" folder looks like this: ^http://www/mysite/com/docs · Or if you want to exclude a url, like the link to folder_contents to be excluded from the catalog: /folder_contents$ · Renamed the skin layer "externalsitecatalogskins" to "externalsitecatalog" config.py now contains an option "debug_requests" for a debug mode that can be useful if you


ExternalSiteCatalog Related Software