#Any search crawler can crawl our site User-agent: * #Allow below mentioned paths Allow: / #Disallow below mentioned paths Disallow: /etc.clientlibs/* Disallow: /bin/* Disallow: /errors/* Allow: /etc.clientlibs/dlt/clientlibs/clientlib-site/resources/images/svg/delta-favicon.ico #Crawl sitemaps mentioned below Sitemap: https://deltaag.com.au/sitemap.xml