Welcome to the Robots.txt Generator! This tool helps you create a robots.txt file easily. The project is built with Next.js and uses Radix UI for the interface.
- Easy Configuration: Choose from a variety of default configurations optimized for popular platforms like WordPress, Shopify, Magento, and more.
- Custom AI Bot Blocking: Select specific AI bots to block from accessing your site.
- Sitemap Integration: Add your sitemap URL to the
robots.txtfile. - Downloadable Output: Generate and download your custom
robots.txtfile. - Validator: Validate your
robots.txtfile and find erros.
Contributions are welcome!
This project is open source and you can see it live here. Feel free to open an issue or create a pull request if you want to collaborate.
If you'd like to contribute, please follow these steps:
- Fork the repository.
- Create a new branch (
git checkout -b feature/your-feature). - Make your changes and commit them (
git commit -m 'Add some feature'). - Push to the branch (
git push origin feature/your-feature). - Open a Pull Request.
This project is open source and available under the MIT License.
If you have any questions or feedback, feel free to open an issue or contact me at Twitter/X.