View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
3569Composr documentationGeneral / Uncategorisedpublic2018-03-28 00:082022-08-15 01:15
ReporterAdam Edington Assigned ToGuest  
PrioritynormalSeverityfeature 
Status newResolutionopen 
Summary3569: Blocking nefarious crawlers via .htaccess changes
DescriptionI am not sure if this is suitable for a distributable CMS, but it does sound like a useful level of protection I don't think we currently have. The .htaccess method sounds the simplest given I'm not sure how many end users will have root server access. Maybe some of the other snippets could be useful too, but primarily the blocking of bad crawlers I think would be beneficial to security and bandwidth/processing?

https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker
TagsType: Spam
Attach Tags
Time estimation (hours)
Sponsorship open

Sponsor

Date Added Member Amount Sponsored

Relationships

Search Commits
related to 3315 ResolvedChris Graham Composr Bundle default robots.txt 
related to 415 ClosedChris Graham Composr robots.txt editor (formerly: "Allow exclusion of contents from sitemap for all content types") 

Activities

Chris Graham

2018-03-28 00:17

administrator   ~5629

We do do some of this already, e.g. the rate limiting feature.

So essentially this is addition of a block list in the default configuration.

I probably would solve this via a tutorial to be honest, but there's a lot to read over, certainly could be some good ideas.

Adam Edington

2018-03-28 00:33

administrator   ~5633

I had a similar file years ago which appeared to work well, but this project seems way more thorough and is active so I thought I'd raise the suggestion that it might be worth a look and you'll certainly make more sense of it than me.

Add Note

View Status
Note
Upload Files
Maximum size: 32,768 KiB

Attach files by dragging & dropping, selecting or pasting them.
You are not logged in You are not logged in. This means you will not get any e-mail notifications. And if you reply, we will not know for sure you are the original poster of the issue.

Issue History

Date Modified Username Field Change
2018-03-28 00:08 Adam Edington New Issue
2018-03-28 00:12 Chris Graham Relationship added related to 3315
2018-03-28 00:13 Chris Graham Tag Attached: Type: Spam
2018-03-28 00:16 Chris Graham Relationship added related to 415
2018-03-28 00:17 Chris Graham Note Added: 0005629
2018-03-28 00:33 Adam Edington Note Added: 0005633
2018-08-29 22:30 Chris Graham Summary [Suggestion] Block nefarious crawlers option => Block nefarious crawlers option
2018-08-29 22:30 Chris Graham Project Composr => Composr documentation
2022-08-15 01:15 Chris Graham Category core => General
2022-08-15 01:15 Chris Graham Summary Block nefarious crawlers option => Blocking nefarious crawlers via .htaccess changes
2023-02-26 18:29 Chris Graham Category General => General / Uncategorised