# Exclude Files From All Robots: User-agent: * Disallow: /design Disallow: /includes User-agent: s1.fti.net Disallow: / User-agent: baudispider Disallow: / User-agent: exabot.com Disallow: / #DOTNETDOTCOM User-agent: dotbot Disallow: / #CUIL User-agent: twiceler Disallow: / #Yandex/Yandrex robot User-agent: Yandex Disallow: / User-agent: VoilaBot Disallow: / User-agent: kalooga Disallow: / # End robots.txt file