bk99.de entertain the web since 1997

bk99.de
Hackaday · StorageCurated

RAID across different network shares

Summary

Hackaday shows a Linux experiment that combines NFS and SMB shares into a virtual RAID 5 array. The example needs only one Linux computer. The setup combines NFS and SMB.

Ideas

  • Linux mounts remote shares as local block paths.
  • Software RAID spreads parity across several network targets.
  • NFS and SMB can work together in the same test setup.

Insights

  • Technical feasibility does not yet mean a safe storage architecture.
  • More layers of abstraction multiply error and consistency states.

Facts

  • The setup combines NFS and SMB.

Recommendations

  • Use such constructions only as a learning experiment.
  • Keep independent backups outside all the shares involved.

References

Read the original article

Search the Web Archive

HF · 2026

Mutable storage buckets in the Hub

Storage buckets add S3-like object storage for checkpoints, logs and intermediate states to the version-oriented repositories. The data remains accessible via browser, script and command line. Buckets are S3-like and are backed by the Xet storage layer.

HF · 2025

Xet has arrived on the Hugging Face Hub

The Hub activates Xet as the storage layer for model and data set artefacts. Users keep Git-like workflows, while transfer and deduplication happen at block level. Xet is gradually replacing Git LFS as the storage path for large Hub files.

HF · 2025

Uploads and downloads from chunk to block

The article explains the conversion of large Hub transfers to block-based Xet storage. Deduplication and parallel transfer are meant to handle changes to large files efficiently. The new architecture splits files into smaller content-addressed blocks.