Indice de Módulo
	Edit file 	

/var/www/enlaces/robots.txt
User-agent: SemrushBot
Disallow: /

User-agent: SemrushBot-SA
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: AhrefsBot 
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: MJ12bot
Disallow: / 

User-agent: SMTBot
Disallow: / 

User-agent: Exabot
Disallow: / 

User-agent: TurnitinBot
Disallow: /

User-agent: SEOkicks
Disallow: /

User-agent: ExtLinksBot 
Disallow: /

User-agent: proximic 
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: BadBot
Disallow: /

User-agent: arachnophilia
Disallow: /

User-agent: webcopy
Disallow: /

User-agent: barkrowler
Disallow: /

User-agent: SeekportBot
Disallow: /