Multiple user-agents not interpreted correctly
Closed this issue · 0 comments
retiman commented
There is a bug where
User-agent: foo
User-agent: bar
Disallow: /baz
...should be interpreted as both foo and bar are not allowed access to /baz, but currently, only bar is restricted.