(Ported from my old blog called Thinky) It’s not rocket science to quickly check the robots.txt and humans.txt for a website but for everything, there is a Chrome Extension. I use the Robots vs Human…
