TailorThemeBot

Seen this crawler in your logs? It belongs to Tailor Theme. It identifies itself as:

TailorThemeBot/0.1 (+https://tailortheme.com)

What it reads

Public pages only: home page, contact page, team page and sitemap. It fills in no forms and logs in nowhere. It identifies the theme a website uses and the company's public contact address.

How often

• At most one request per second, per domain.
• It respects robots.txt.
• It stops as soon as it gets a 429 or 403 response.
• Every page is cached, so it does not fetch it again needlessly.

Block it

Add these lines to your robots.txt:

User-agent: TailorThemeBot
Disallow: /

Questions? [email protected]