Boost your website SEO
Google Robots crawl websites to rank it higher in search
We have an option called Crawlable website which will help Google Robots to find your website faster and index it for a better search with a higher ranking:
You can find this option here in edit website:
So if this option will be enabled then in the page source will have this: name="robots" content="index,follow,noarchive"> and the Google Robots can rank your website higher in the search - Example below:
https://www.google.com/search?q=onecom.no
If the option is disabled then in source page will have: name="robots" content="index,nofollow,noarchive"> and your website won't be indexed properly for a good search result.
These above rules are taken and implemented from Google Documentation here:
https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag