Function Hook_health_check_marketing_seo_robotstxt->robots_allowed
Definitions
sources/hooks/systems/health_checks/marketing_seo_robotstxt.php
- Find whether the robots.txt allows a URL to be indexed.
- Visibility: protected
- Is abstract?: No
- Is static?: No
- Is final?: No
- Return: bool
Parameters
Name | Type | Default | Set | Range | Description |
---|---|---|---|---|---|
$url | URLPATH | required parameter | N/A | N/A | The URL |
$user_agent | string | required parameter | N/A | N/A | The user-agent |
$google_style | boolean | required parameter | N/A | N/A | Whether to evaluate robots.txt like Google would (Google is slightly non-standard) |
Return
- Whether robots access is allowed
- Type: boolean
- Set: N/A
- Range: N/A