How to Configure robots.txt File in Magento 2

Magento 2 is a hearty internet business stage that offers various elements and functionalities to arrange Magento 2 and deal with it.

One of the fundamental components of a web-based store is the robots.txt record, which assumes an essential part in guiding web search tools on the most proficient method to slither and list the webpage's pages.

The robots.txt record is a basic text document that lives in the root registry of a site and illuminates web crawler bots which pages or segments of the webpage ought not be crept or indexed.In this blog entry, we'll clarify how to configure the robots.txt file in Magento 2.

For more info, visit https://webguru.dev/how-to-configure-robots-txt-file-in-magento-2/