bk99.de entertain the web since 1997

bk99.de
CCC · Linux storageCurated

The evolution of storage solutions on Linux

Summary

Lenz Grimmer traces the path from local file systems through LVM and cluster file systems to distributed, parallel and fault-tolerant Linux storage. Every additional storage layer trades simplicity for flexibility or resilience. Distribution removes single hardware failures but creates new consistency and operational problems.

Ideas

  • Local file systems optimise consistency and performance within a single machine.
  • LVM separates logical storage allocation from physical disks.
  • Cluster file systems coordinate parallel access by several machines.
  • Distributed systems scale capacity and redundancy across many nodes.

Recommendations

  • Choose a storage architecture by its failure model rather than by maximum features.
  • Regularly test data loss, network partitions and complete recovery.

References

Watch the talk

Search the Web Archive

CCC · 2022

Linux security monitoring with audit events

Hilko Bengen shows how Linux auditd delivers fine-grained host events and how the unwieldy format can be made usable for attack detection with reasonable effort. Network monitoring only detects many attacks together with context from the affected host. More telemetry only helps if events are reliably correlated and prioritised.

CCC · 2020

Running your own Matrix server on Arch Linux

Brendan Abolivier explains Matrix as a federated communication standard and shows how your own homeserver on Arch Linux becomes part of the network. Decentralisation distributes control but increases the demands on operations and moderation. Self-hosting only creates sovereignty with reliable updates, backups and key protection.

CCC · 2019

Home directories for modern Linux systems

Lennart Poettering presents systemd-homed, which combines Linux home directories with encryption, portable identities, modern authentication and structured user records. A decades-old directory model now carries authentication, encryption and mobility at the same time. Convenient encryption comes about when key management is integrated into the normal login process.