| View previous topic :: View next topic |
| Author |
Message |
svankamon
-
Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK
|
 Posted: Mon Mar 03, 2008 10:01 am Post subject: Robot.Txt |
 |
|
Hi, seems just about every other help system on the net is pretty none existant.
Im back again with a robot.txt problem. Ive visited robot.txt.org and the usual google help files and it all seems pretty simple. However ive created some robot txt's and they are not recognisable by google. I used the following format but cant get it to work. Can anyone give me any ideas.
User-Agent: *
Disallow: /http://mydmain.com/config_folder/
Its as simple as that so their instructions say but as mentioned it doesnt work on googles robot.txt tester page.
Any assistance much apreciated.
Thanks |
|
| Back to top |
   |
 |
olly86
-
Joined: 25 Apr 2003
Posts: 993
Location: Wiltshire, UK
|
| Posted: Mon Mar 03, 2008 12:31 pm Post subject: |
|
|
You need to use a relative path, not an absolute one.
So instead of: /http://mydmain.com/config_folder/
try: /config_folder/
_________________
Olly |
|
| Back to top |
|
|
svankamon
-
Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK
|
| Posted: Mon Mar 03, 2008 1:30 pm Post subject: robots.txt |
|
|
Thanks mate but ive tried that, i just tried it again and that doesnt work either. The error says:
Syntax not understood
??? Any ideas? Thanks for your responce. |
|
| Back to top |
|
|
svankamon
-
Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK
|
| Posted: Mon Mar 03, 2008 1:33 pm Post subject: continued |
|
|
However i have placed robot text files in each of my domains and the google bot comes up with Success 200.
But the lower: "Test URLs against this robots.txt file" comes up with the aforementioned Syntax error. Am i then to presume that the robot text is actually working ok. Thanks again. |
|
| Back to top |
|
|
rrinc
-
Joined: 24 Feb 2006
Posts: 725
Location: Arkansas, USA
|
| Posted: Mon Mar 03, 2008 2:14 pm Post subject: |
|
|
Isn't it robots.txt?
_________________
-Blake | New Server :D
SaveTheInternet
Soy hispanohablante. Puedes contactarme por mensajes privados. |
|
| Back to top |
   |
|
svankamon
-
Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK
|
| Posted: Mon Mar 03, 2008 2:30 pm Post subject: Thanks |
|
|
Yes. It seems to be working ok, although im not sure but it seems to be.
If you can also help i have updated the page since i submited to google and an older version of the cache is loading (which i cant get rid of) and links that werent properly optimized are showing. Will these eventually disapear with the new sitemap? and other optimization settings? Im told not but id like more assurance than google can offer. ???? MAny thanks again. |
|
| Back to top |
|
|
pkSML
-
Joined: 29 May 2006
Posts: 952
Location: Michigan, USA
|
| Posted: Thu Mar 06, 2008 11:04 pm Post subject: |
|
|
You'll probably need to wait a few days while your site and/or sitemap is in Google's query box. They should get around to crawling your website again soon and update their cached page a few days after that.
_________________
Stephen
Need a LitlURL?
http://CodeBin.yi.org |
|
| Back to top |
|
|
svankamon
-
Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK
|
| Posted: Fri Mar 07, 2008 12:31 am Post subject: Thanks |
|
|
Thanks and much apreciation to you. It seems everyday a few more pages get indexed and the new meta tags etc are changing from the old/error ones (lack of experience made me upload before changing to find out which files to change on some of the scripts)
Slowly but surely theyre all changing around. Thanks again for your apreciated help. Good luck to yall. Bye for now. No doubt il be back, but if this just happens to be about the best forum on the net where questions get answered instaead of ignored what can i do about it.
Good job aprelium and all users. Good luck etc, etc, etc. |
|
| Back to top |
|
|
|
