🚀 Hey Product Hunt! 🚀 I'm super excited to share robots.txt Generator with you! This tool makes creating and managing your robots.txt file easier than ever. 🎉 Why did I create this? I know setting up a robots.txt file can be tricky, especially if you're not familiar with the technical stuff. Whether you have a blog, an online store, or any website, my goal is to make this process simple and give you control over how search engines and web crawlers interact with your site. 🛠 What can you do with robots.txt Generator? Easy-to-Use Interface: Our intuitive design, built with Next.js and Radix UI, lets you create a robots.txt file with ease. - Custom AI Bot Blocking: Easily select and block specific AI bots from accessing your site. - Sitemap Integration: Add your sitemap URL to help search engines find and index your important content. - Downloadable Output: Generate and download your custom robots.txt file with just a few clicks. - Validator: Check your robots.txt file to make sure it's correctly formatted and works as expected. 💡 Why is it awesome? - Simple: No need to worry about syntax or technical jargon. It's easy for everyone. - Flexible: Customize your robots.txt file to fit your needs. - Open Source & Free: That's right! It's open source and completely free to use. Check out our GitHub repo and join our awesome community. 🤝 Join us! I’d love to hear your feedback and ideas. If you find a bug, have a suggestion, or want to contribute, head over to our GitHub repo. We're building this together, and every contribution counts! Thank you so much for checking out robots.txt Generator. Your support means the world to me! If you have any questions or need help, just drop a comment below. I'm here to help!

I wanted to thank everyone for the support I am receiving not only on Product Hunt but also on different social networks. Honestly, I didn't expect this simple tool to be so well-received. I am glad to know it can be helpful for people who dedicate time and effort to launching web projects. I would like to remind you that this tool is completely free and open source, so you can contribute to the project through GitHub. Best regards and thanks again.

Launched at the perfect moment = right when needed. Thank you

This tool seems like a fantastic solution for simplifying the management of robots.txt files. How does your tool handle complex scenarios where specific pages need different crawling rules based on user behavior or geographic location?

Seems to be a great tool. good luck with your launch.

congrats on the launch of robots.txt generator. making the management of such files easier is crucial for site owners. how are users finding the custom ai bot blocking feature so far? any interesting usage patterns emerging?

Great launch, Óscar! What are the future features you plan to add to the robots.txt Generator?

Congratulations on your launch! A very simple and easy-to-use tool!

Wow, what a fantastic tool! It's great to see something that simplifies such a technical aspect of website management. Kudos to the team for making it open source and free for everyone!

Congrats on the launch! Seems like a cool product.

I love how Robots.txt Generator simplifies creating and managing robots.txt files, making it easy for all users without technical expertise to control their site interactions efficiently. Great job!

I think you need to update it again. I cannot select both 'Based on your requirements' and 'Based on your project.' I want to allow a specific user agent to access my website along with the WordPress settings, but I cannot select it as such.

Love the simple and quick nature of the product. Kudos for open sourcing it!

Comment Deleted

Thank you very much! It’s really a very helpful tool

looks interesting

I don't know if you're aware of it, but now you cannot select an item from the first list and an item from the second list (example if you want to have both wordpress default + blocking specific directories). A completely ignorant SEO person could hurt himself using this app, and an experienced SEO person doesn't need it. It's kinda of in the middle in my opinion.

The robots.txt Generator looks like a powerful yet simple tool for creating and managing robots.txt files. It’s great that it allows control over how search engines, web crawlers, or AI bots interact with your site. How user-friendly is the interface for someone new to SEO? @oscar_bustos

Simple. Quick. Complete. Open source. I don't have words to praise it enough. Congratulations on the PH launch, Óscar. Jolly good, Ash (:

thanks!