Guide

SEOSiteCheckerBot

SEOSiteCheckerBot is the user agent our address-checking tools send when a visitor asks us to check an address. See what it requests, how often it visits and how to block it.

Free to use 4 min read Updated Nov 2026

What SEOSiteCheckerBot is

Quick answer: SEOSiteCheckerBot is the user agent our address-checking tools send when a visitor types your address into one of them. It requests that address and the redirects it leads to. It never crawls your site on its own.

seositechecker.pro offers free website tools, for example tools that follow redirects, test a robots.txt file or show the robots directives of a page. When someone types a web address into one of them, our server fetches that address so it can show the result. SEOSiteCheckerBot is the name it uses while doing that, so the visit appears in your logs under a name you can look up and, if you wish, block.

It is not a search engine crawler. It does not build an index, it does not follow links on its own, and it never visits an address that nobody asked about. A few other tools on the site send a different user agent, and the section on when it visits says which.

The user agent string

Every request from SEOSiteCheckerBot, including each redirect it follows, sends this user agent:

Text
SEOSiteCheckerBot/1.0 (+https://seositechecker.pro/page/seositechecker-bot)

The token to look for in your logs is SEOSiteCheckerBot. The address in brackets leads to this page. When you see the token, a person asked one of our tools to look at your address.

When it visits

SEOSiteCheckerBot runs only when a person submits an address to one of our tools. There is no schedule, no list of websites to revisit and no discovery of new sites. What it requests depends on the tool.

  • Tools that look at one address. They request the address the visitor typed and the redirects it leads to, up to ten hops. A tool that tests your robots.txt file, or checks whether a page is blocked from search engines, also requests the robots.txt file of the website the visitor typed.

Other tools do not send this token. The SEO audit and the website screenshot tool open the page in a real browser engine so they can show it the way a visitor sees it, and they send an ordinary browser user agent because the page has to behave the way it does for people. Some of our older tools also identify themselves differently.

How often it can visit

The tools that send this user agent share limits that keep one visitor, or one website, from being hit hard through us.

WhatLimit
Runs of tools that look at one addressUp to 20 a minute against one website, counted across every visitor and every tool that sends this user agent
Redirects followed in one runUp to 10
Request methodsGET and HEAD only
Connectionshttp and https, on ports 80, 443, 8080 and 8443 only

What it does with the pages it fetches

The tools that send this user agent show the result to the visitor who asked for it. They do not add the pages they fetch to an archive or a search index. To avoid asking your server twice for the same thing, a result can sit in a short-lived cache and is then discarded. SEOSiteCheckerBot does not log in, submit forms, run scripts or change anything on your site.

The SEO audit works differently. It runs in a real browser and keeps its result, with screenshots of the page, as a report page on this website.

robots.txt and SEOSiteCheckerBot

The tools that send this user agent do not use robots.txt to decide whether to fetch an address. A person asked for that exact address, which is the same as opening it in a browser. Some of these tools do read the file, but only to show the visitor what it says, and they apply the rules of the Robots Exclusion Protocol to do so. A robots.txt group that names SEOSiteCheckerBot therefore does not stop them.

How to block SEOSiteCheckerBot

Match the token SEOSiteCheckerBot at your web server and answer with a 403 status. On Apache, add this to your .htaccess file.

Text
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} SEOSiteCheckerBot [NC]
RewriteRule .* - [F,L]

On nginx, add this inside the server block that serves your website.

Text
if ($http_user_agent ~* "SEOSiteCheckerBot") {
    return 403;
}

Blocking affects only checks that visitors run on your website through the tools that send this user agent. To ask us to stop every check of your website, including the ones that use a browser, write to us through the contact page below. Blocking has no effect on how search engines crawl or rank your website, because they use their own user agents.

How to reach us

If you think SEOSiteCheckerBot is misbehaving, or you want to ask about a visit, write to us through the contact page. Include your website address and the lines you saw in your logs.

Frequently Asked Questions

Is SEOSiteCheckerBot a search engine crawler?
No. It does not crawl, build an index or follow links on its own. It runs only when a person submits an address to one of our free tools, and it requests that address plus the redirects or links the tool needs to answer the question. Blocking it has no effect on how search engines crawl your site.
Why did SEOSiteCheckerBot visit my website?
Someone typed one of your addresses into a tool on seositechecker.pro, for example a redirect checker or a robots.txt tester. The visit is one request for that address, plus any redirects it leads to. It happens only when that person presses the button. Nothing visits your site on a schedule.
How do I stop SEOSiteCheckerBot from visiting my website?
Block the user agent token SEOSiteCheckerBot at your web server and answer with a 403 status. A robots.txt group does not stop these tools, because they do not use robots.txt to decide whether to fetch an address. Tools that do not send this token, such as the SEO audit and the screenshot tool, are not affected, so write to us if you want those stopped too. The page above has examples for Apache and nginx.
Does SEOSiteCheckerBot ignore robots.txt?
The tools that request one address a visitor typed do not use robots.txt to decide whether to fetch it, because a person asked for that exact address, the same as opening it in a browser. Some of them read the file, but only to show the visitor what it says.

See how your site scores right now

Paste your address into the free report, then use the How to Fix button on anything that needs work.

Free to use. Results in under a minute for most sites.