Robots.txt Generator

Robots.txt Generator

Free robots.txt generator with AI bot blocking

Free robots.txt generator. Block paths, add exceptions and your sitemap, and optionally block AI bots. Copy the finished file and upload it to your site root. No sign-up.

Marketing · SEO

Features

Block specific paths, add allow exceptions and your sitemap URL, optional AI bot blocking, copy-ready output, no sign-up.

Use Cases

Starter robots.txt for a new site, blocking AI crawlers, adding a sitemap line before launch.

SmartBi

AI copilot that turns marketing data into next steps

Comments

Killian. H

Nice and simple, and no sign-up is a plus! qq can I block AI training bots (GPTBot, CCBot) but still allow AI search bots (OAI-SearchBot, PerplexityBot)? That's the setup I would want for a product site.

Upvote Reply

Premium Products

Clipcroft

Send anything between devices. Free, no signup, no install

boldrouter

One API for every model. Swiss developed & hosted.

Inteldo

One question. Eight agents. Real answers.

SpicyAPI

Uncensored AI video and image models in one API and Studio

rock identify

Free Online Rock Identifier by Photo | Rock Identify

TrustGrowth

Verified SEO scores. Open playbook. Public proofs.

SearchVoro

Measure, fix & prove your SEO in Google and AI answers

StarterKitPro

StarterKitPro is your 90% done SaaS starter kit - all in Next.js

ScoutYourCity.com

Find something awesome to do in your city.

PawAlarm

Helping you find your missing pets fast and safely

HeyPolo

HeyPolo is a privacy-first location sharing app for famalies

FlowMRR

Stripe revenue analytics for SaaS teams

Peptide Titans

Research peptides with a published COA for every lot

Nereo

AI video and ad creation for brands and creators

Prisma Postgres

50 free postgres databases, one for every idea.

AI Website Auditor

See if ChatGPT and other AIs recommend your business

Telvana

The AI agent platform for contact centers

LineWhale

Dive deep into the odds. Surface with the best line.

Loupe

Free accessibility checker that explains every WCAG fix

Mindful Render

AI meditation videos and audio in your own voice, in minutes

Gixo Arc

Turn source material into a proposal your team can review

VantaSoft Agent Service

Custom AI agents, built for your business

Quady3D AI

From idea to export: your complete 3D workflow

EaseGen

Latest AI image & video models in one affordable workspace

call4me

An AI agent that calls and gets things done for you

AutomatedSEO

Get found on Google and in AI answers, without an SEO team

SubCenter for Teams

SaaS and AI spend for small teams, from your inbox

HProxy

Residential proxies from $0.44 per GB

Spicy API (spicyapi.com)

Adult AI API: role-play chat, images, video, voice, calls

AI Background Remover - EzMaker AI

Turn any photo into a clean cutout with free AI background r

Lacuna

AI Song Generator and AI Lyrics Generator in one studio

PopNow

AI video, image and music studio, no subscription

FastSocial Instagram Data API

Public Instagram profiles, posts and reels as clean JSON

LAYSO AI

One API Key for 300+ AI Models

九曜印占 Jiuyao Yinzhan

中文 AI 印度占星：免费排盘，围绕你的问题持续追问

ZelNum

Bulk & realtime WhatsApp, phone & email verification

MODCAR.ai

AI car customization and photo editing

Whisk AI

Create, edit and remix images with AI

reTrek

Daily walks you'll stop skipping

LanoX

One API for GPT, Claude, Gemini & Grok, up to 95% off

MerivoFlow

Simple, low-cost Pinterest scheduler that plans months ahead

Folksee

Group video messages for any occasion

Minute of Fame

A live clock where every minute of the day has an owner

Raileon Business Checkup

Score your Google profile, website and email vs 3 rivals

Buy

SmartBi

AI copilot that turns marketing data into next steps

Red Leaf Research Labs

Buy research peptides in Canada with verified lab reports

Commune

A shared home for builders to launch, connect, and grow

Mansoor Bhanpurawala · Follow

SEO Consultant

Makers

Mansoor Bhanpurawala · Follow

SEO Consultant