SEOClerks

Discussions about Spiders

Showing page: 1 of 1

Screaming frog has become one of my main SEO tools that I'm using on a daily basis. Helps me check almost every aspect of a website's on-page optimization and shows me the number and type of errors. The free version ...

  • Cristian
    Cristian Level X3
  • 4 9 years ago

    Is there a way to prevent a spider from attaching itself to a URL that you do not want on the search engines?

  • angie828
    angie828 Level X3
  • 4 13 years ago