> Markdown version of [/magazine/26-the-funniest-robots-txt-files-only-developers-will-understand](https://www.wearedevelopers.com/magazine/26-the-funniest-robots-txt-files-only-developers-will-understand). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # The funniest robots.txt files only developers will understand **By:** Thomas Limbüchler **Published:** January 8, 2021 The robots.txt file is based on the Robots exclusion standard. The file tells Google's web crawler and other bots crawling the web which content to capture. The robots.txt file is thus usually generated by programs and is thus not intended for human eyes. Still, some developers have fun "decorating" their robots.txt files with funny texts or ASCII images. ## The robots.txt – a playground for grown-ups Many of these hidden messages remain true to the filename as they refer to well-known robots. The robot Bender from the popular cartoon series Futurama is part of a whole series of robots.txt files. Or are in a nod to Isaac Asimov's laws of robotics. Others take up general internet phenomena such as keyboard cat. While companies such as Nike or Starbucks hide their company logo. References to job vacancies are also popular as it shows an unusual, high level of interest in a company. Bender is a popular motif when creating robots.txt (robotstxt.org.ru): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84c962188eddbc6bc51c9_robotstxtorg-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) Back to the Future (arenaflowers.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84cafc4ff1a16cfd097ca_arenaflowerscom-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) The Google founders want to protect themselves from the terminator (google.de): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84cbc1e587922e74edcec_googlede-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) The originator of this file should be clear (nike.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84cc6d39755da2a0e253f_nikecom-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) The robots.txt file of YouTube comes from the future (youtube.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84ccff752e8160336738f_youtubecom-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) There are also Asimov fans at Yelp (yelp.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84cd960c61b65c5953761_yelpcom-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) Tripadvisor uses robots.txt to recruit new employees (tripadvisor.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84ce91240130da96cb4e3_tripadvisorcom-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) Again Bender (tindeck.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84cf71e587948684edcfb_tindeckcom-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) Keyboard cat in the robots.txt file (sharkseo.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84d012f7d90e682b5cb55_shartseo-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) And again Bender (reddit.com): ![](https://wearedevelopers.imgix.net/public/magazine/articles/26/images/5ff84d0e2188ed127bbc52c1_redditcom-robotstxt.jpg?w=720&fit=max&dpr=2&auto=format) ## Related Articles - [Google's Most Creative Easter Eggs](https://www.wearedevelopers.com/magazine/647-google-s-most-creative-easter-eggs) - [Dev Digest 122 - Cracks in the polyfill](https://www.wearedevelopers.com/magazine/457-dev-digest-122-cracks-in-the-polyfill) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [Dev Digest 116 - WWWAI?](https://www.wearedevelopers.com/magazine/449-dev-digest-116-wwwai) ## Related Videos - [Command the Bots: Mastering robots.txt for Generative AI and Search Marketing](https://www.wearedevelopers.com/videos/1165-command-the-bots-mastering-robots-txt-for-generative-ai-and-search-marketing) - [Humanoid Runs Wild, Google Rewrites Headlines and Slow AI - Justin Halsall and Schepp](https://www.wearedevelopers.com/videos/1843-humanoid-runs-wild-google-rewrites-headlines-and-slow-ai-justin-halsall-and-schepp) - [DOOM on Neurons, Training AI with Harry Potter & Robots Watching YouTube - Zoran Jambor](https://www.wearedevelopers.com/videos/1823-doom-on-neurons-training-ai-with-harry-potter-robots-watching-youtube-zoran-jambor) - [Fake or News: LLMs Protect Each Other, Google Predicts Floods, and GitHub Copilot Loves COBOL - Niels Leenheer](https://www.wearedevelopers.com/videos/1860-fake-or-news-llms-protect-each-other-google-predicts-floods-and-github-copilot-loves-cobol-niels-leenheer) ## Related Jobs - [AI Software Engineer (Germany)](https://www.wearedevelopers.com/jobs/48317-ai-software-engineer-germany) at **Sunhat** - [Senior Software Engineer](https://www.wearedevelopers.com/jobs/ext/15942-senior-software-engineer) at **GitHub** - [Principal Engineer - AI Search & Vector Infrastructure](https://www.wearedevelopers.com/jobs/ext/319507-principal-engineer-ai-search-vector-infrastructure) at **Redis** - [Principal Engineer - AI Search & Vector Infrastructure](https://www.wearedevelopers.com/jobs/ext/353953-principal-engineer-ai-search-vector-infrastructure) at **Redis** - [Principal Engineer - AI Search & Vector Infrastructure](https://www.wearedevelopers.com/jobs/ext/381484-principal-engineer-ai-search-vector-infrastructure) at **Redis** - [Principal Software Engineer, Enterprise AI Platform](https://www.wearedevelopers.com/jobs/ext/1467292-principal-software-engineer-enterprise-ai-platform) at **GitHub**