My private forums are being indexed bt search engines. But when the search engines try to ping the urls, they get 404 as its set to private. This is producing thousands of broken links error which is not good.
I tried to disallow search engine bots by telling them not to index private forums by private names in the url. Then I noticed the forum names are not being added to the permalink, so there;s no way to disallow bots to index private forum links.
This is a critical issue. Most of the forums have private forums. All of them are having the same issue. Why am I the only one noticing this? Is there any settings I am missing?
Please let me know.