Search engines like google and yahoo will not likely know what to do Together with the URL . It can be unclear to them whether they're allowed to access. When directives usually are not distinct to Google, they can go Together with the the very least restrictive directive, which in https://rankingseotoolz.com/robots-txt-generator