Robot.Txt

 
Post new topic   Reply to topic    Aprelium Forum Index -> General Questions
View previous topic :: View next topic  
Author Message
svankamon
-


Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK

PostPosted: Mon Mar 03, 2008 10:01 am    Post subject: Robot.Txt Reply with quote

Hi, seems just about every other help system on the net is pretty none existant.

Im back again with a robot.txt problem. Ive visited robot.txt.org and the usual google help files and it all seems pretty simple. However ive created some robot txt's and they are not recognisable by google. I used the following format but cant get it to work. Can anyone give me any ideas.

User-Agent: *
Disallow: /http://mydmain.com/config_folder/

Its as simple as that so their instructions say but as mentioned it doesnt work on googles robot.txt tester page.

Any assistance much apreciated.

Thanks
Back to top View user's profile Send private message Send e-mail
olly86
-


Joined: 25 Apr 2003
Posts: 993
Location: Wiltshire, UK

PostPosted: Mon Mar 03, 2008 12:31 pm    Post subject: Reply with quote

You need to use a relative path, not an absolute one.

So instead of: /http://mydmain.com/config_folder/
try: /config_folder/
_________________
Olly
Back to top View user's profile Send private message
svankamon
-


Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK

PostPosted: Mon Mar 03, 2008 1:30 pm    Post subject: robots.txt Reply with quote

Thanks mate but ive tried that, i just tried it again and that doesnt work either. The error says:

Syntax not understood

??? Any ideas? Thanks for your responce.
Back to top View user's profile Send private message Send e-mail
svankamon
-


Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK

PostPosted: Mon Mar 03, 2008 1:33 pm    Post subject: continued Reply with quote

However i have placed robot text files in each of my domains and the google bot comes up with Success 200.

But the lower: "Test URLs against this robots.txt file" comes up with the aforementioned Syntax error. Am i then to presume that the robot text is actually working ok. Thanks again.
Back to top View user's profile Send private message Send e-mail
rrinc
-


Joined: 24 Feb 2006
Posts: 725
Location: Arkansas, USA

PostPosted: Mon Mar 03, 2008 2:14 pm    Post subject: Reply with quote

Isn't it robots.txt?
_________________
-Blake | New Server :D
SaveTheInternet
Soy hispanohablante. Puedes contactarme por mensajes privados.
Back to top View user's profile Send private message Visit poster's website Yahoo Messenger MSN Messenger
svankamon
-


Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK

PostPosted: Mon Mar 03, 2008 2:30 pm    Post subject: Thanks Reply with quote

Yes. It seems to be working ok, although im not sure but it seems to be.

If you can also help i have updated the page since i submited to google and an older version of the cache is loading (which i cant get rid of) and links that werent properly optimized are showing. Will these eventually disapear with the new sitemap? and other optimization settings? Im told not but id like more assurance than google can offer. ???? MAny thanks again.
Back to top View user's profile Send private message Send e-mail
pkSML
-


Joined: 29 May 2006
Posts: 908
Location: Michigan, USA

PostPosted: Thu Mar 06, 2008 11:04 pm    Post subject: Reply with quote

You'll probably need to wait a few days while your site and/or sitemap is in Google's query box. They should get around to crawling your website again soon and update their cached page a few days after that.
_________________
Stephen
Need a LitlURL?


http://CodeBin.yi.org
Back to top View user's profile Send private message Visit poster's website
svankamon
-


Joined: 01 Apr 2007
Posts: 148
Location: Chesterfield UK

PostPosted: Fri Mar 07, 2008 12:31 am    Post subject: Thanks Reply with quote

Thanks and much apreciation to you. It seems everyday a few more pages get indexed and the new meta tags etc are changing from the old/error ones (lack of experience made me upload before changing to find out which files to change on some of the scripts)

Slowly but surely theyre all changing around. Thanks again for your apreciated help. Good luck to yall. Bye for now. No doubt il be back, but if this just happens to be about the best forum on the net where questions get answered instaead of ignored what can i do about it.

Good job aprelium and all users. Good luck etc, etc, etc.
Back to top View user's profile Send private message Send e-mail
Display posts from previous:   
Post new topic   Reply to topic    Aprelium Forum Index -> General Questions All times are GMT + 1 Hour
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB phpBB Group