DuckDuckGo Not Respecting Robots.txt Directives?

There is an interesting thread at Hacker News on DuckDuckGo being toyed by Google. That part honestly doesn't interest me as much as the core SEO topic in the thread. Google's Matt Cutts is very active on Hacker News and he questioned Gabriel Weinberg, the founder of DuckDuckGo, about the DuckDuckGo spiders and crawlers. There are some … Continue reading DuckDuckGo Not Respecting Robots.txt Directives?

Advertisements