SaaS Browser Bot - Crawler Information

SaaS Browser is a free and open search engine dedicated to helping people discover new SaaS products and software solutions. It is completely free to search, with no account or signup needed.

Getting your SaaS listed on SaaS Browser helps potential customers discover your solution when they're actively searching for software. Being indexed in a dedicated SaaS search engine puts your product in front of decision-makers ready to evaluate new tools, and it's completely free. If our crawler can access your site, you're likely already getting this exposure.

Want more control? You can claim your profile, upload screenshots, and show your product in its best light. If our bot hasn't found your product, it's free and easy to submit it for inclusion (signup is required).

About our crawler

SaaS Browser Bot crawls the web to discover and index SaaS products, software tools, and related content. We are committed to responsible crawling and respect webmaster preferences.

User agent string

Our bot identifies itself with the following user agent:

Mozilla/5.0 (compatible; SaaSBrowserBot/1.0; +https://saasbrowser.com/bot)

Respecting your preferences

robots.txt

We fully respect robots.txt directives. Our bot checks your robots.txt file before crawling any pages on your domain. To block our bot, add the following to your robots.txt file:

User-agent: SaaSBrowserBot
Disallow: /

Meta robots tags

We respect the noindex directive in HTML meta tags:

<meta name="robots" content="noindex">

HTTP headers

We also honor the X-Robots-Tag HTTP header:

X-Robots-Tag: noindex

Please note that adding any noindex directive to your website will remove it from our index of SaaS products.

Crawl behavior

• A maximum of 1 request per second per domain.
• A typical crawl frequency of once every 30 days, to refresh content, check your website is still online, and check whether you want your site removed from our index.
• Requests are only made over HTTPS to sites with a valid SSL certificate.

What we collect

We index:

• Product names and descriptions
• Pricing information (when publicly available)
• Features and capabilities
• Company information
• Public reviews and testimonials

We do not collect:

• Personal user data
• Login credentials
• Private or gated content
• Content behind paywalls

Verifying our bot

To verify that a request genuinely comes from SaaS Browser Bot and not a scraper spoofing our user agent, use a two-step DNS check. First, do a reverse DNS lookup (PTR record) on the requesting IP address. The hostname should resolve to crawler.saasbrowser.com or *.saasbrowser.com. Second, do a forward DNS lookup on that hostname and confirm it resolves back to the original IP address.

For example:

$ nslookup 45.55.138.37
37.138.55.45.in-addr.arpa    name = crawler2.saasbrowser.com.

$ nslookup crawler2.saasbrowser.com
Non-authoritative answer:
Name:    crawler2.saasbrowser.com
Address: 45.55.138.37

Privacy and data

We are committed to protecting privacy and handling data responsibly. For information about how we handle indexed data and user privacy, please see our Privacy Policy.

Questions? Reach out to us at [email protected].