3FS

核心与官方官方模型与基建MIT官方维护
[](https://github.com/deepseek-ai/3fs/actions/workflows/build.yml) ](LICENSE)

功能特性

  • Performance and Usability
  • Strong Consistency Implements Chain Replication with Apportioned Queries (CRAQ) for strong consistency, making application code simple and easy to reason about.
  • Diverse Workloads
  • Data Preparation Organizes outputs of data analytics pipelines into hierarchical directory structures and manages a large volume of intermediate outputs efficiently.
  • Dataloaders Eliminates the need for prefetching or shuffling datasets by enabling random access to training samples across compute nodes.
  • Checkpointing Supports high-throughput parallel checkpointing for large-scale training.

项目预览

项目简介

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

相关文档

话题标签

#distributed-file-system
← 返回 核心与官方 列表