Back to overview
Maintenance

False Downtime Due to Monitoring Misconfiguration

Jul 19 at 03:30pm +0530  –  Jul 26 at 11:00am +0530
Affected services
SG3

Resolved
Jul 19 at 03:30pm +0530

An incident was triggered when our monitoring tools reported that several proxy nodes were offline or unreachable. After investigation, we confirmed that the nodes were fully operational. The issue stemmed from a failure to update the monitoring system with the new server IP addresses after recent server deployments.

⚠️ Root Cause
New proxy servers were added and assigned new IP addresses.

These IPs were not updated in the monitoring configuration.

The monitoring system attempted to ping old IPs, resulting in false downtime alerts.

🧩 Resolution
Updated the monitoring tool with the correct server IPs.

Verified server status and performance manually to confirm all were online.

Suppressed false alerts and re-synced monitoring with current inventory.