User-agent: AhrefsBot
Disallow: *
User-agent: SemrushBot
User-agent: *
Disallow: /api/*
Disallow: /file/*
Disallow: /invite/*
Disallow: /f/* # files
Disallow: /l/* # links
Disallow: /t/* # thumbnails
Allow: /