Skip to main content

URL List Indexing

If the crawler misses specific URLs, or you only need to index a small number of pages, use the URL List to add pages to the index manually.

URL List

This differs from adding URLs individually under Index in two ways:

  • The URL List is not purged during a full re-index, whereas links added manually under the Index section are deleted.
  • The URL List supports bulk entry via Edit as Text, rather than copying and pasting URLs one at a time.

The URL List supports up to 2,000 pages per project. If you plan to add several hundred pages, consider using a custom sitemap instead — it reduces server load and speeds up subsequent re-indexes.

You can assign the URL List to a Result Group to keep these pages grouped in your search results.

No-index, whitelisting, and blacklisting rules apply only to content indexed via sitemap or root URL. Pages added to the URL List will appear in search results even if they match no-index or blacklisting criteria, and will remain searchable even if they match a whitelisting pattern.