Marketing Forums                      

Welcome to the fastest-growing internet marketing forums!

Go Back   Marketing Forums > Webmaster's Lounge > HTML & Website Design

HTML & Website Design Place to talk about website design and get help with HTML, CSS, DHTML, etc.

Reply
Submit Tools Thread Tools Search this Thread Display Modes
Unread 05-05-2018, 05:32 AM   #1
efusionworld
Senior Member
 
efusionworld's Avatar
 
Join Date: Jul 2017
Location: Pompton Plains, NJ 07444
iTrader: 0
Referrals: 0
Posts: 106
Reputation: 10
efusionworld is on a distinguished road
Default Correct Robots.txt in wordpress?

How do you configurate robots.txt in wordpress?

it is my robots.txt, is correct?

User-agent: *
Allow: /wp-content/uploads/
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: /template.html
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /wp-trackback
Disallow: /wp-feed
Disallow: /wp-comments
Disallow: */trackback
Disallow: */feed
Disallow: */comments
Disallow: /tag
Disallow: /category
Disallow: /archive
Disallow: */trackback/
Disallow: */feed/
Disallow: */comments/
Disallow: /?feed=
Disallow: /?s=

Disallow: /20*/
Allow: /wp-content/uploads/
Allow: /wp-includes/js/
Allow: /wp-includes/css/

User-agent: Googlebot
Allow: /wp-admin/css
Allow: /wp-admin/js

efusionworld is offline   Reply With Quote
Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
What are Spiders, Robots and Crawlers ? Stevendavis Chit Chat 3 08-18-2018 07:25 AM
META TAG ROBOTS hairee HTML & Website Design 7 05-10-2014 10:40 AM
Robots.txt ghazia SEO - Search Engine Optimization 0 03-15-2012 08:37 AM


All times are GMT. The time now is 01:36 AM.


Navigation
Marketing Forums Homepage
Forum Home
Marketing Forums News
iTrader
Calendar
Forum Rules
Forum Statistics

FREE Link Directory
Link Directory Home
Link Exchange Programs
Affiliate Networks
Business Opps
CPM Ad Networks
Contextual Ad Networks
Domain Parking
Paid To Click
Paid To Read
Paid For Action
Paid To Promote
Shopping Rewards
Pay Per Click Programs
PPC Search Engines
Pay Per Sale
Work At Home Opps
Advertisements

Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
Marketing Forums | This is a Metabin Ltd. Website