41,554 blogs · 4,904,241 posts Claim your blog

Back to Netdata Blog

Blog · corpus.blog/blogs/netdata.cloud/posts

Netdata Blog

netdata.cloud

Undated

Cassandra killed by the Linux OOM killer: off-heap memory and RSS original ↗

—

Cassandra large partition pathology: Compacting large partition warnings and reads original ↗

—

Cassandra Monitoring original ↗

—

Cassandra monitoring checklist: the signals every production cluster needs original ↗

—

Cassandra native transport not running: node UP in gossip but refusing CQL clients original ↗

—

Cassandra node showing DN in nodetool status: gossip, phi, and recovery original ↗

—

Cassandra Not enough space for compaction: STCS space amplification and recovery original ↗

—

Cassandra OperationTimedOutException: client-side timeouts vs server timeouts original ↗

—

Cassandra pending compactions growing: the compaction backlog runbook original ↗

—

Cassandra ReadTimeoutException: diagnosing coordinator read timeouts original ↗

—

Cassandra repair not running: the silent gap that resurrects deleted data original ↗

—

Cassandra Scanned over N tombstones warning: finding the offending query original ↗

—

Cassandra TombstoneOverwhelmingException: reads aborted by tombstone_failure_threshold original ↗

—

Cassandra Too many open files: file descriptor exhaustion original ↗

—

Cassandra too many SSTables per table: read amplification and how to fix it original ↗

—

Cassandra UnavailableException: not enough replicas for the consistency level original ↗

—

Cassandra zombie data resurrection: gc_grace_seconds and unrepaired tombstones original ↗

—

Celery Monitoring original ↗

—

Ceph backfill_toofull: recovery blocked because target OSDs are full original ↗

—

Ceph blocked ops: client I/O stuck behind a single slow OSD original ↗

—

Ceph BLUEFS_SPILLOVER: RocksDB metadata spilling onto the slow device original ↗

—

Ceph capacity death spiral: an OSD fails and recovery has nowhere to go original ↗

—

Ceph degraded objects: reduced redundancy and the race against a second failure original ↗

—

Ceph FS_DEGRADED: standby MDS failed to take over a rank original ↗

—

Ceph HEALTH_ERR: reading the umbrella status and finding the real fault original ↗

—

Ceph LARGE_OMAP_OBJECTS: the RGW bucket-index OMAP storm and resharding original ↗

—

Ceph monitor quorum lost: the cluster can no longer update its maps original ↗

—

Ceph Monitoring original ↗

—

Ceph monitoring checklist: the signals every production cluster needs original ↗

—

Ceph nearfull: the 85% warning that decides whether the cluster can heal original ↗

—

Ceph OSD down: telling a dead disk apart from a network blip original ↗

—

Ceph OSD flapping: OSDs cycling up and down and the peering storm that follows original ↗

—

Ceph OSD_FULL: all writes stopped at the 95% full ratio original ↗

—

Ceph PG degraded: fewer replicas than the pool size, and when it matters original ↗

—

Ceph PG down: no surviving replica for reads or writes original ↗

—

Ceph PG incomplete: placement groups that cannot serve I/O original ↗

—

Ceph PG inconsistent (OSD_SCRUB_ERRORS): scrub found replica divergence original ↗

—

Ceph slow requests (SLOW_OPS): operations blocked past osd_op_complaint_time original ↗

—

Ceph unfound objects: the cluster cannot locate a surviving copy original ↗

—

Chia Monitoring original ↗

—

Christ Elektronik CLM5IP Monitoring original ↗

—

Chrony Monitoring original ↗

—

Cilium Agent Monitoring original ↗

—

Cilium Operator Monitoring original ↗

—

Cilium Proxy Monitoring original ↗

—

ClamAV Daemon Monitoring original ↗

—

Clamscan Results Monitoring original ↗

—

Clash Monitoring original ↗

—

ClickHouse Active Part Count Growing: How To Fix original ↗

—

ClickHouse cannot connect to ZooKeeper/Keeper: diagnosing the coordination layer original ↗

—

ClickHouse checksum mismatch and broken parts: detecting data corruption original ↗

—

ClickHouse DB::Exception: Too many parts - causes and fixes original ↗

—

ClickHouse DelayedInserts climbing: the warning before too-many-parts original ↗

—

ClickHouse disk space collapse: why merges need free space and how the spiral starts original ↗

—

ClickHouse disk space monitoring: free_space, unreserved_space, and the 80% target original ↗

—

ClickHouse distributed DDL stuck: ON CLUSTER queries that never finish original ↗

—

ClickHouse full table scan: partition pruning failures and the primary key original ↗

—

ClickHouse Keeper saturation spiral: too many tables, DDL storms, and cluster freeze original ↗

—

ClickHouse killed by the OOM killer: RSS, max_server_memory_usage, and cgroup limits original ↗

—

ClickHouse long-running queries: finding and killing the resource hog original ↗

—

ClickHouse Memory limit (for query) exceeded: per-query limits and GROUP BY/JOIN blowups original ↗

—

ClickHouse Memory limit (total) exceeded - server-wide memory pressure and fixes original ↗

—

ClickHouse memory pressure death spiral: runaway queries, retries, and OOM original ↗

—

ClickHouse merge death spiral: when parts accumulate faster than merges consolidate original ↗

—

ClickHouse merges not keeping up: diagnosing a stalled or starved merge pool original ↗

—

ClickHouse Monitoring original ↗

—

ClickHouse monitoring checklist: the signals every production cluster needs original ↗

—

ClickHouse mutation stuck: parts_to_do not decreasing and how to recover original ↗

—

ClickHouse mutations silently blocking merges: the hidden cause of part growth original ↗

—

ClickHouse No space left on device: emergency recovery when the data disk fills original ↗

—

ClickHouse query error rate high: reading exception codes 241, 252, and 999 original ↗

—

ClickHouse query latency P99 spikes: tail latency, hot shards, and cold data original ↗

—

ClickHouse Replica is lost: SYSTEM RESTORE REPLICA and recovering a diverged replica original ↗

—

ClickHouse replication lag: absolute_delay, queue_size, and catch-up diagnosis original ↗

—

ClickHouse replication queue stuck: num_tries, last_exception, and dead entries original ↗

—

ClickHouse small inserts anti-pattern: why single-row inserts melt the merge pool original ↗

—

ClickHouse Table is in readonly mode: is_readonly on replicated tables and how to fix it original ↗

—

ClickHouse too many partitions: why over-partitioning multiplies your part count original ↗

—

ClickHouse Too many simultaneous queries: max_concurrent_queries and query storms original ↗

—

ClickHouse ZooKeeper session has expired: causes, recovery, and tuning original ↗

—

Cloud Foundry Firehose Monitoring original ↗

—

Cloud Foundry Monitoring original ↗

—

CloudWatch Monitoring original ↗

—

ClusterControl CMON Monitoring original ↗

—

CockroachDB Backup Job Failures: How To Fix Them original ↗

—

CockroachDB certificate expired: TLS handshake failures and online rotation original ↗

—

CockroachDB changefeed lag: changefeed_max_behind_nanos and the GC time bomb original ↗

—

CockroachDB clock skew cascade: how shared NTP drift causes quorum loss original ↗

—

CockroachDB clock synchronization error: this node is more than 500ms away from at least half of the known nodes original ↗

—

CockroachDB clock_offset_meannanos high: catching clock drift before self-termination original ↗

—

CockroachDB compaction backlog growing: when Pebble can't keep pace with writes original ↗

—

CockroachDB connection storm after failover: reconnect stampedes and surviving-node overload original ↗

—

CockroachDB consistency check failed: checksum mismatches and confirmed corruption original ↗

—

CockroachDB context deadline exceeded: timeouts, slow ranges, and overload original ↗

—

CockroachDB CPU saturation: Raft ticking, SQL execution, and the per-node ceiling original ↗

—

CockroachDB detecting hot ranges: per-range QPS, CPU asymmetry, and the Hot Ranges page original ↗

—

CockroachDB disk stall detected: storage_disk_stalled and node self-termination original ↗

—

CockroachDB error 53200: SQL memory budget exhausted and query rejection original ↗

—

CockroachDB LSM compaction death spiral: L0 sublevels, read amplification, and write stalls original ↗

—

CockroachDB memory pressure, GC thrashing, and Raft liveness failure original ↗

—