# Robots.txt for Gunadhya Software Solutions # Last updated: 2026-11-13 # Default rules for all crawlers (search engines and AI crawlers included) User-agent: * Allow: / Disallow: /application/ Disallow: /system/ Disallow: /uploads/ Disallow: /sass/ Disallow: /project-doc/ # Blocked scrapers User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: Scrapy Disallow: / User-agent: MJ12bot Disallow: / # Keep these only if you never use Ahrefs or Semrush User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / # Sitemaps Sitemap: https://www.gunadhyasoft.com/sitemap.xml Sitemap: https://www.gunadhyasoft.com/insight/sitemap_index.xml