06-10-2024, 05:35 AM
(06-10-2024, 01:37 AM)l0st Wrote: It used to be a requirement to be listed on Google that the site owner provide a registered account for indexing. You can refuse to provide one, but if the spider cannot access pages due to restricted access, it lowers the page rank for the remaining pages. Google wants you to exclude inaccessible content with robots.txt.
Even if Google is not publishing all the pages in the index, they've certainly slurped down copies of your entire site for their own internal DB. Google wants to be behind your paywall and will penalize you if you do not give them access.
I understand it now, thanks.
But that would not have given Google access to the other accounts' data, and, if I'm not mistaken, that's what we're talking about.
