Comments (3)
Just want to make things clear:
>> 1. put Disallow: /example/ in robots.txt
If /example/some-page appears before robots.txt is updated. This has no effect.
>> 2. or put /example/ in Excluded URL patterns
Yes, this is an expected behavior.
>> 3. what it works if you put /example/* in Excluded URL patterns
This works. Right?
Original comment by [email protected]
on 25 Feb 2009 at 5:27
from googlesitemapgenerator.
with latest beta i check now if it works
1) point seems to me that robots.txt rules are now working /example/
and /example/2 are now ignored and not added in latest beta (from 25 Feb)
2) OK but i thought that the same rules from robots.txt are applied
so it should be more consistent to apply the same rules as in robots.txt
/example/ to be like /example/*
3. yes i was just notice you that i was expecting /example/ to ignore all
subdirs
/example/2 ...
Original comment by [email protected]
on 26 Feb 2009 at 9:23
from googlesitemapgenerator.
Experiencing the same problem: /eDM/ and /WDSearch/ are both disallowed in
robots.txt. Configured GSG to exclude /eDM/* and /WDSearch/* and URLs still
included. Configured GSG to exclude /eDM/ and /WDSearch/ and URLs still
included.
Using sitemap_win-beta1-20091231.msi on Windows 2003
Original comment by [email protected]
on 5 Mar 2010 at 10:39
from googlesitemapgenerator.
Related Issues (20)
- sitemap
- Module "GoogleSitemapGeneratorModule" could not be found HOT 2
- [deleted issue]
- XML Sitemap
- Site Map file empty, why?
- [deleted issue]
- Product killed server
- [deleted issue]
- [deleted issue]
- Windows installer fails to request password for admin console
- How to install IIS virtual sever HOT 2
- submitting a sitemap on an https only site HOT 1
- [deleted issue]
- [deleted issue]
- nikagbo.com
- www.besttune24.tk
- rangpur crime news HOT 1
- Cosmolinda Website Map
- http://musiclody.com/artist/tonosmp3android
- http://orgpage.kz/areas/astana-r/
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from googlesitemapgenerator.