Online Search engine crawlers may have a look at many different factors when crawling a web-site. Not each web site is indexed by search engines like google. The distance of web pages in the root directory of a site may be a Consider whether or not webpages get crawled.[38] [33] https://bowsalon.com