Aussieveedubbers · General Chit Chat

searches, robots.txt, google enlightenment wanted

https://forums.aussieveedubbers.com/threads/30968/searches-robotstxt-google-enlightenment-wanted

amazer ·

Nooow, with my dodgy old website for wscc I did nothing to raise profile in searcheds except a few meta keywords. Looking up wscc in google (australia) my site members.ozemail.blah is 2nd on the list. Looking up wollongong sporting car club comes 3rd. Putting that between " " comes up 2nd.

Now with the new slightly less dodgy wscc.org.au I cant get it to show up high in the list. This is despite registering it a few places, having the same keywords, and even have (invisible, its black) text on the page.

I see in the logs that search engines are loooking for the robots.txt file. Am I right in thinking that this is only to STOP bots from going into places you dont want mapped?

I dont understnad how the ozemail members page ranks so high when the wscc.org doesnt. Enlighten me plz.

amazer ·

nobody knows? but you're all usually so full of knowledge!