Check X-Robots-Tag HTTP header for noindex, nofollow, noarchive. Page-level index control. Free online.
Related tools