24/7 AI website monitoring: security, indexing and health checks