Learn how to handle 404 errors by capturing the exact URL and time they occur....

https://domgodwinson38.gumroad.com/p/how-do-i-check-if-the-page-is-blocked-by-robots-txt-or-noindex

Learn how to handle 404 errors by capturing the exact URL and time they occur. This helps you quickly find and fix broken links