YaCy Tutorial #05 Easy Web Crawl
A tutorial about the YaCy ‘Site Crawler’ which is the simplest way to place a lot of documents from the Web into your own web search index.
If you start a ‘Site Crawling’ then YaCy loads all web pages from a single domain to the YaCy search index. Use this, if you reckon that a specific domain is missing in your search result.
If you are running in peer-to-peer mode (which is the default) then all web pages indexed with you crawler will be available to the other YaCy index in the ‘freeworld’ search network.
Download YaCy here:
Music: Shiryu – Space Crystal