SeaweedFS is a simple and highly scalable distributed file system. There are two objectives: to store billions of files! to serve the files fast! Instead of supporting full POSIX file system semantics, SeaweedFS choose to implement only a key~file mapping. Similar to the word "NoSQL", you can call it as "NoFS".
 
Instead of managing all file metadata in a central master, the central master only manages file volumes, and it lets these volume servers manage files and their metadata. This relieves concurrency pressure from the central master and spreads file metadata into volume servers, allowing faster file access (just one disk read operation).
 
SeaweedFS started by implementing <a href="http://www.usenix.org/event/osdi10/tech/full_papers/Beaver.pdf">Facebook's Haystack design paper</a>. SeaweedFS is currently growing, with more features on the way.

SeaweedFS is a simple and highly scalable distributed file system. There are two objectives: to store billions of files! to serve the files fast! Instead of supporting full POSIX file system semantics, SeaweedFS choose to implement only a key~file mapping. Similar to the word "NoSQL", you can call it as "NoFS".

SeaweedFS - Simple and highly scalable distributed file system

Afero is an filesystem framework providing a simple, uniform and universal API interacting with any filesystem, as an abstraction layer providing interfaces, types and methods. Afero has an exceptionally clean interface and simple design without needless constructors or initialization methods.Afero is also a library providing a base set of interoperable backend filesystems that make it easy to work with afero while retaining all the power and benefit of the os and ioutil packages.
 
Afero provides significant improvements over using the os package alone, most notably the ability to create mock and testing filesystems without relying on the disk.

Afero is an filesystem framework providing a simple, uniform and universal API interacting with any filesystem, as an abstraction layer providing interfaces, types and methods. Afero has an exceptionally clean interface and simple design without needless constructors or initialization methods.Afero is also a library providing a base set of interoperable backend filesystems that make it easy to work with afero while retaining all the power and benefit of the os and ioutil packages.

Afero - A FileSystem Abstraction System for Go

Jimfs is an in-memory implementation of Java 7's java.nio.file abstract file system API. imfs supports almost all the APIs under java.nio.file. Jimfs also supports creating file systems that, for example, use Windows-style paths and (to an extent) behavior. In general, however, file system behavior is modeled after UNIX and may not exactly match any particular real file system or platform.
  

jimfs - An in-memory file system for Java 7+

Discover open source projects across all platforms

Projects

SeaweedFS - Simple and highly scalable distributed file system

Afero - A FileSystem Abstraction System for Go

jimfs - An in-memory file system for Java 7+

TechStack

Tagcloud

Suggested keywords:

Projects

SeaweedFS - Simple and highly scalable distributed file system

Afero - A FileSystem Abstraction System for Go

jimfs - An in-memory file system for Java 7+

TechStack

Tagcloud