# SE Crawlers Setup
 
## Enable robots.txt rules for all crawlers

User-agent: *
Sitemap: http://woknroll.ky/sitemap.xml

## SETTINGS FOR WOKNROLL

# Directories
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

# Paths (clean URLs)
Disallow: /tag
Disallow: /author