πΈοΈ Domain Crawling Explained
A domain crawling method refers to the way our system collects and identifies the pages (URLs) on your website that will be scanned for accessibility. You can choose to add these pages manually, upload a sitemap, or let our tool automatically index all URLs linked to your domain.
π’ Domain Crawling Methods
There are three different ways you can enter the URLs associated with the domain you would like to scan:
1. Add a link to your sitemap
When you first add a domain to your dashboard, we will first give you the option to add your sitemap URL. This indexing method is faster and ensures our tool can collect all of the URLs associated with your domain more easily.
Should you not have a sitemap URL or would prefer not to use it, there are two other methods to choose from. You will find these two options once you scroll down on the Add Domain pop-up.
2. Auto-index your website
Auto-indexing your website means our tool will manually collect all of the URLs associated with your domain. Please note that this method tends to take longer than adding your sitemap, particularly if you have a larger site.
3. Add URLs manually
Even though you will get to pre-select the URLs you want to include in your scan using the above two methods, we also give you the option to manually add the URLs you would like to scan right from the start.
