In what order does the crawler scan the webite, i,e. how does it determine the scan priority?


The Monsido crawler scans data as it finds it. This is normally breadth-first, for example, the scan starts at level 0 (the front page of the website) and proceeds to level 1 (pages that are accessed via links from the front page), and continues in this way.

Did this answer your question?