Introduction to crawling - Fluid Topics - Latest

Fluid Topics Configuration and Administration Guide

Category
Reference Guides
Audience
public
Version
Latest

Search engines use crawlers, also called bots, to visit websites on a regular basis and index their content. As a result, users can enter search terms in an external search engine and directly filter on only those websites containing the most relevant information.

For example, Google regularly crawls docs.fluidtopics.com. Since the Google crawling tool indexes content from docs.fluidtopics.com, users can search for and access Fluid Topics' documentation via Google's list of search results. When searching for "enrich and clean" on Google, the "Enrich and Clean" technical note on docs.fluidtopics.com appears at the top of the list of search results:

A screenshot of a Google search results page for the query 'enrich and clean'. The first result is a link to 'Enrich and Clean Metadata - Fluid Topics - Latest' on docs.fluidtopics.com, followed by a brief description. The second result is a link to 'Apply vocabularies - Fluid Topics - Latest' on the same website, also followed by a brief description.