Goque provides embedded, disk-based implementations of stack and queue data structures. Motivation for creating this project was the need for a persistent priority queue that remained performant while growing well beyond the available memory of a given machine. While there are many packages for Go offering queues, they all seem to be memory based and/or standalone solutions that are not embeddable within an application.

goque - Persistent stacks and queues for Go backed by LevelDB

A lightning fast, transactional, file-based FIFO for Android and Java. QueueFile is a lightning-fast, transactional, file-based FIFO. Addition and removal from an instance is an O(1) operation and is atomic. Writes are synchronous; data will be written to disk before an operation returns. The underlying file is structured to survive process and even system crashes and if an I/O exception is thrown during a mutating change, the change is aborted.

Tape - A lightning fast, transactional, file-based FIFO for Android and Java.

A big, fast and persistent queue based on memory mapped file.
 
Features include: 
<ol>
<li>Fast: close to the speed of direct memory access, both enqueue and dequeue are close to O(1) memory access.</li>
<li>Big: the total size of the queue is only limited by the available disk space.</li>
<li>Persistent: all data in the queue is persisted on disk, and is crash resistant.</li>
<li>Reliable: OS will be responsible to presist the produced messages even your process crashes.</li>
<li>Realtime: messages produced by producer threads will be immediately visible to consumer threads.</li>
<li>Memory-efficient: automatic paging &amp; swapping algorithm, only most-recently accessed data is kept in memory.</li>
<li>Thread-safe: multiple threads can concurrently enqueue and dequeue without data corruption.</li>
<li>Simple&amp;Light-weight: current number of source files is 12 and the library jar is less than 30K.</li>
</ol>

A big, fast and persistent queue based on memory mapped file.

Big Queue - A big, fast and persistent queue based on memory mapped file.

Discover open source projects across all platforms

Projects

goque - Persistent stacks and queues for Go backed by LevelDB

Tape - A lightning fast, transactional, file-based FIFO for Android and Java.

Big Queue - A big, fast and persistent queue based on memory mapped file.

TechStack

Tagcloud

License

Suggested keywords:

Projects

goque - Persistent stacks and queues for Go backed by LevelDB

Tape - A lightning fast, transactional, file-based FIFO for Android and Java.

Big Queue - A big, fast and persistent queue based on memory mapped file.

TechStack

Tagcloud

License