#1389 - XML Sitemap index
-
By Chris Graham
- Added
- 4 views
| Identifier | #1389 |
|---|---|
| Issue type | Feature request or suggestion |
| Title | XML Sitemap index |
| Status | Completed |
| Handling member | Chris Graham |
| Addon | core |
| Description | Currently Composr builds a single sitemap nightly. For a large website, this is resource-intensive and risks going over the 50,000 sitemap URL/10MB limit.
Ideally we would support the sitemap API putting out everything since the last "archival date", and then iteratively updating the sitemap index file to include the refreshed reference to the latest sitemap. It would have to calculate the archival date in a smart way, noting when it approaches a certain limit (e.g. 5000 URLs per sitemap). |
| Steps to reproduce | |
| Additional information | Old sitemaps would contain URLs duplicated in newer sitemaps, if the article had been refreshed. This is not a serious problem though. |
| Related to | |
| Funded? | No |
The system will post a comment when this issue is modified (e.g., status changes). To be notified of this, click "Enable comment notifications".
Comments
Implementation differs to description. Actually works much better, this is very efficient (can scale to millions of URLs), and can handle deletions of URLs from the sitemap.