Awesome Level

An open list of awesome Level modules and resources. Add yours!

Table of Contents

Bundles

Convenience modules that bundle a store with levelup and encoding-down.

Name	Compatibility	Dependencies	Description
level			Bundle for leveldown and level-js. Main entry point for beginners.
level-mem			Bundle for memdown.
level-rocksdb			Bundle for rocksdb.
level-hyper			Bundle for leveldown-hyper.
level-indexed			Bundle for indexeddown. Alternative to level.

Core

Name	Dependencies	Description
levelup		The glue that holds everything together. Use this when you need a custom or swappable store.
abstract-leveldown		An abstract prototype matching the leveldown API. Use this to implement your own store.
level-packager		Package helper to export a bundle. Use this to create a new level-* bundle.

Stores

Modules that implement abstract-leveldown as storage for levelup.

Name	Compatibility	Dependencies	Type
leveldown			LevelDB
memdown			In-memory RBTree
level-js			IndexedDB
rocksdb			RocksDB
leveldown-hyper			HyperLevelDB
medeadown			medea
jsondown			JSON on disk
asyncstorage-down			AsyncStorage (React Native)
mongodown			MongoDB
sqldown			sqlite3, pg, mysql, WebSQL
dynamo-down			AWS DynamoDB
azureleveldown			Windows Azure Table Storage
fruitdown			IndexedDB (Apple)
localstorage-down			localStorage
riakdown			riakpbc
mysqldown			MySQL
redisdown			Redis
leveldown-basho			Basho's LevelDB fork
sheet-down			Google Sheets
indexeddown			IndexedDB
lmdb-leveldown			LMDB
localdown			localStorage in Node.js
aerospike-leveldown			Aerospike
s3leveldown			AWS S3
gaiadown-ts			Gaia
dynamodb-leveldown			AWS DynamoDB
localforagedown			localForage
react-native-leveldown			LevelDB (React Native)

Layers

Modules that implement abstract-leveldown to wrap another abstract-leveldown. This is the preferred extension point.

Name	Compatibility	Dependencies	Description
encoding-down			Provides key/value encoding.
@adorsys/encrypt-down			Provides encryption for values.
deferred-leveldown			Handles delayed-open. Built into levelup.
level-cowdown			Copy-on-write abstract-leveldown layer.
abstract-stream-leveldown			A stream-based abstract prototype.

Encodings

Custom level-codec compatible encodings for use with encoding-down.

Name	Dependencies	Description
charwise		Encode/decode with same encoded sort order as bytewise.
bytewise		Binary serialization which sorts bytewise for arbitrarily complex data structures. NB. Use charwise if possible. Gives you almost everything bytewise does but much faster.
protocol-buffers		Protocol Buffers for Node.js. Compiled messages are level-codec compatible encodings.
lexicographic-integer-encoding		Wraps lexicographic-integer.

Sublevels

Modules related to splitting a database into sections a.k.a. sublevels.

Name	Dependencies	Description
subleveldown		Split a levelup database into sublevels with their own keyspace, encoding and events.
level-temp		Create a temporary subleveldown sublevel that is guaranteed to be empty.
level-mount		Mount multiple abstract-leveldown stores by key prefix onto a single store. Can be used with subleveldown.
bytespace		Keypath subspaces prefixed with bytewise tuples. Similar to level-sublevel. NB. bytewise - and thus bytespace - can be slow. Consider using subleveldown paired with the charwise encoding instead.
level-sublevel		Adds the ability to create subsections with the same API as levelup, but only write/read to a prefixed section, or bucket, of the key-space. Each section also has level-hooks installed. NB. No longer maintained. We recommend subleveldown instead.
sublevel-prefixer		Utility to prefix a key with a sublevel prefix.
level-sublevel-stream		Find level-sublevel sublevels, not requiring them to be in memory already.
level-subtree		Generate a tree from level-sublevel sublevels, useful when there is no manifest.
level-superlevel		Superlevel adds a "super" level that allows accessing the entire database, discovering level-sublevel sublevels and browsing the database without knowledge of the sublevel structure.
level-subkey		Use path-like keys to separate sections of levelup, with hooks. Adapted from level-sublevel.
level-mirror		Mirror and optionally transform data from one level-sublevel sublevel into another.

Processing

Modules for indexing, alternative forms of querying data, MapReduce models and other forms of data processing.

Name	Dependencies	Description
level-auto-index		Automatic secondary indexing for levelup and subleveldown.
jsonquery		Query levelup with a MongoDB-like query API that returns streams.
jsonquery-engine		A full MongoDB query language implementation with indexes for querying levelup.
level-indico		Yet another indexing plugin for levelup. By providing only a low-level querying mechanism it gives you the power to build more complicated and optimized queries on top of it. NB. Relies on bytewise and level-sublevel, both of which have caveats.
level-inverted-index		Create an inverted index for full-text search.
map-reduce		A MapReduce implementation on top of levelup. Allows you to define a map reduce query that will run on top of your db. The map reduces are incremental, and you can query the results in real-time.
level-map-merge		Like map-reduce but simpler. Has a batch component that runs periodically, and a real-time component that fills in the gaps. Good for generating inverted indexes.
level-queryengine		A generic pluggable query-engine system (that supports indexes) for levelup.
level-trigger		Triggers for levelup. Runs an async job when a key changes. All jobs will eventually run, even across restarts!
levels		A light-weight full text search engine for levelup (Port of TJ's reds redis search engine).
map-reduce-chained		Extends map-reduce and level-mapped-index to provide easy to setup chained MapReduce. An example use case is to find the top 10 values after a reduce.
path-engine		Query levelup using a JavaScript property path array syntax with indexes.
subindex		Generic pluggable indexing system for levelup.
level-sec		High-level API for creating secondary indexes.
level-secondary		Create and query secondary indexes.
inverted-index		Inverted index built upon levelup.
level-index-update		Remove the old indexes in the same batch as the new ones are inserted.
range-index		Range indexes for levelup.
level-path-index		Index properties of items that live in a tree of materialized paths.
level-sql		SQL queries for levelup.
level-hash-index		Store any string into levelup, and get a collision free hash of that value that you can use in an index (or similar).
level-idx		Another high-level API for creating secondary indexes, using level-auto-index.
level-indexer		Generic indexer for levelup. Only stores document keys for space efficiency.
level-librarian		Lightweight indexing and querying with the LLCJ query language.
level-match-index		Index and filter level-sublevel databases and watch for future changes.
level-assoc		Relational foreign key associations (hasMany, belongsTo) for levelup.
level-tree-index		Tree indexer for levelup.
changes-index		Create indexes from a changes-feed. Provides a way to create a materialized view on top of an append-only log.
changesdown		levelup interface that uses an abstract-leveldown store that writes to a changes-feed to store its state.
level-ordered		A wrapper for level that keeps inserted items ordered.

Databases

Complete Node.js databases built with Level.

Name	Dependencies	Description
dat		Lets you build streaming data pipelines that can be shared and replicated by others.
pouchdb		PouchDB allows you to store and query data offline and then sync with CouchDB when online. For Node, browser and mobile.
couchup		A CouchDB implementation on top of levelup.
firedup		A node.js implementation of firebase based on levelup.
len		Len is a resource booking database using LevelDB for storage. Useful for calendar and gantt chart apps and for questions like 'can a customer book this resource starting X and ending Y'.
lem		Lem is a telemetry storage database using LevelDB. Keys are indexed by timestamp and you can read values in-between 2 points in time.
levelgraph		A Graph database built on top of levelup with pattern-matching and join support.
linvodb3		Persistent database on top of levelup for Node.js/NW.js with MongoDB-style queries, Mongoose-like models and a map/reduce system.
rxdb		Event-driven database based on pouchdb. Optimized for reactive programming with observables. Events and state is automatically shared between multiple browser tabs. Queries are defined by the mongoDB mango-standard.
pushdb		A programmable database with document storage and unique indexing capabilities.
search-index		A persistent full text search engine for browser and Node.js.
tacodb		A responsive, Node.js-style database ideal for realtime data. Highly modular and adaptable, allowing extension with the Level ecosystem.
timestreamdb		A full-featured timeseries database on top of LevelDB. Includes a library for streaming statistical operations on timeseries data including joins, aggregates, filters, and map-like operations.
@nano-sql/core		A small (10Kb) RDBMS abstraction on top of levelup that also runs in the browser with undo/redo support, immutable objects and IndexedDB persistence.
vertical		LevelDB distributed, Server and Client!
flash-store		FlashStore is a Key-Value persistent storage with easy to use ES6 Map-like API(both Async and Sync support), powered by LevelDB and TypeScript.
level-fact-base		Store immutable facts and query them with datalog.
dulcimer		Define JSON models and manage indexes, children, foreign keys and much more.
levi		Stream based full-text search for Node.js and browser using levelup.
level-mongo		MongoDB-like database backed by LevelDB.
level-orm		Simple ORM built on levelup.
level-lively		levelup implementation of LivelyDb for doing real-time data binding of a database with local javascript objects.
kwdb		REST wrapper for levelup.
level-restful		REST wrapper for levelup, as an extension to level-orm.
level-rest		REST wrapper for levelup. NB. Not compatible with latest levelup.

Shared Access

Name	Dependencies	Description
multileveldown		Share a levelup instance across multiple processes or over the network. An alternative to multilevel, implemented as abstract-leveldown stores with seamless retry support.
level-party		Open a LevelDB (leveldown) handle multiple times, transparently upgrading to multileveldown when more than 1 process try to use the same LevelDB data directory at once and re-electing a new master when the primary unix socket (or named pipe) goes down.
cluster-levelup		Wrap a levelup instance for cluster usage among multiple processes.
multilevel		Share a levelup instance over the network.
multilevel-http		Expose a levelup instance via HTTP.
level-range-emitter		Client and server using multileveldown, range-emitter and ltgt.
level-manifest		Describe the functions that multilevel should provide access to on the client.
level-cluster-get		Given a key, get all values from a cluster of multilevel servers.
level-connect		Connect to a level-party and level-sublevel enabled LevelDB over HTTP.
level-sandbox		A sandbox for hosting multilevel enabled databases.
level2riak		A network service that allows you to connect to a Riak database over HTTP.
leveldb-mount		LevelDB server and client with optional client-side REPL. Built with subleveldown and multileveldown.
level-pubsub		PubSub with server and client on top of levelup.
level-query		Expose a level-sublevel database over HTTP, searchable with query strings.
level-over-http		Another solution to expose levelup over HTTP.
level-rpc		Fast RPC mechanism for levelup. Intended as binary-compatible alternative to multilevel.

Streams

Node.js stream or pull-stream implementations for reading and writing data from/to levelup.

Name	Dependencies	Description
level-ws		General-case, streams3 writable stream for levelup.
level-batch-stream		Streams2 writable stream for levelup.
level-writestream		Streams2 writable stream for levelup.
level-write-stream		Streams1 writable stream for levelup or abstract-leveldown.
level-delete-stream		A streams1 deleteStream for levelup.
pull-level		pull-stream interface to levelup with read streams, write streams and realtime (tail/live) reads.
level-live-stream		Like db.createReadStream() except it's live / tailable. i.e. instead of ending, it will stay open and stream changes to the database as they are inserted.
level-live		Simple, light and correct live read stream implementation. NB. Uses an undefined streams version.
level-livefeed		A live query of a range in levelup. Similar to level-live-stream but with a streams2 interface.
level-range		Find all K/V-pairs prefixed by a certain key. Streams1.
level-cursor		A stream "cursor" to iterate through a ReadStream / KeyStream / ValueStream.
level-glob		A streams2 read stream filtered and ordered by glob patterns. Keys in the database should be unix-like paths.

Iterators

Modules that operate on abstract-leveldown iterators.

Name	Dependencies	Description
level-concat-iterator		Concatenate items from an iterator into an array.
level-iterator-stream		Turn an abstract-leveldown iterator into a readable stream. Included in levelup.
levelup-async-iterator		Add an iterator() method to levelup with Symbol.asyncIterator. NB. Conflicts with iterator() added in [email protected].
level-iterator		Decoding iterator for levelup instances. Wraps iterators like level-iterator-stream does. NB. Not compatible with levelup >= 2 due to encodings having moved out to encoding-down. PR welcome.

Hooks

Low-level utilities for hooking into a levelup instance.

Name	Dependencies	Description
level-events		Get an event everytime something is written / read / deleted using levelup.
level-hookdown		Simple levelup hooks.
level-post		Consistent post hooks for levelup.
level-condition		Get notified when a condition is triggered inside a levelup instance.
level-hooks		Implements a hook mechanism that allows you to intercept put, delete and batch operations. You can then turn those operations into batches. Useful if you want to turn a put into an atomic batch for say an automatic map operation. NB. Author recommends using level-sublevel instead of level-hooks directly. Note that level-sublevel is not maintained.

Range Options

Utilities for working with range options, known as ltgt(e), common to levelup streams and abstract-leveldown iterators.

Name	Dependencies	Description
ltgt		Tool belt to find lower or upper bounds, compare and filter keys and more.
level-option-wrap		Wrap ltgt options with functions. Expose range options without leaking information about your internal key representations.
interval-to-ltgt		Convert an interval string to an ltgt object. This is the counterpart to ltgt-to-interval.
ltgt-to-interval		Convert an ltgt object to an interval string. This is the counterpart to interval-to-ltgt.
range-emitter		Range emitter. Publish keys and subscribe to ranges.

Data Structures

Modules that utilize a specific key/value scheme to provide a higher-level data structure.

Name	Dependencies	Description
merkle-dag		Merkle DAG on top of LevelDB
merkle-patricia-tree		Implementation of the modified merkle patricia tree as specified in Ethereum's yellow paper.
level-array		The array datatype inside levelup.
level-set		Add a set method to levelup for saving objects in a tree-like structure.
level-push		Add a push method to levelup for saving objects using level-set with auto-generated UUID.
level-version		Store and retrieve versioned data in levelup.
level-queue-type		The queue datatype inside levelup.
level-q		Priority queuing for levelup.
qool		A queue backed by levelup, durable and FIFO.
level-trie		The TRIE data structure and search algorithm, on top of levelup.
level-geospatial		Store key values pairs with lat/lon coordinates, and query using a radius.
level-pathwise		Turn levelup into one huge object of arbitrary size! Efficiently and atomically update and read parts of it.
level-places		Store and retrieve places near a lat/long pair.
level-nearby-stream		Stream in nearby places using the browser's geolocation and level-places.
level-tree		Geospatial indexing for GeoJSON in levelup
level-list		Map lists of data stored in levelup to DOM elements.
level-reactive		Reactive templating for data stored in levelup.
level-paginate		Streaming pagination for levelup.
level-average		Calculate rolling averages in levelup.
level-sum		Calculate sums in levelup and get live updates.
level-historical-json		Keep a history of all the changes of a JSON document.
level-immutable		levelup immutable history and database snapshotting based on ideas in datomic.
level-model		A higher-level module for creating content models using levelup and JSON Schema validation.
level-stream		Persist streams in levelup.
level-stay		An alternative approach to storing scuttlebutts in levelup.
skeyma		Turns a template string (like ${forumId}/${postId}) into parse/serialize streams that transform objects like {forumId, postId, text} into key-value pairs and back.
level-autotable		Auto incrementing keys with "fields" and "records".
level-forks		Forking graph of cascading namespaces.
level-geo		A geospatial index for levelup.
level-geography		Indexed geography storage in levelup.
accountdown		Persistent user accounts.
accountdown-model		A wrapper around accountdown that provides a few additional features

Transience

Name	Dependencies	Description
cachedown		LRU cache implemented as an abstract-leveldown layer.
level-ttl		Add a ttl (time-to-live) option to levelup. NB. Suffers from race issues. See also tiny-level-ttl.
tiny-level-ttl		Add a ttl (time-to-live) option to levelup, level-sublevel or level-spaces. Also respects level-lock.
level-live-cache		An in-memory cache that keeps up to date with its source.
level-lru-cache		Simple LRU cache.
level-ttl-cache		A pass-through cache for arbitrary objects or binary data using LevelDB, expired by a TTL.
level-cache		A caching module you can place in front of a levelup database. It will cache a subset of the database in an in-memory LRU cache based on configuration. It has an optional synchronous API which will return from the cache only.
levelup-cache		Use levelup to cache remote data.

Atomicity

Name	Dependencies	Description
level-lock		In-memory advisory read/write locks for levelup keys.
level-mutex		Mutex read/write lock for levelup.
level-updater		Update keys without overlapping changes - makes it possible to implement an atomic incrementer, JSON merger, etc.
levelplus		Adds atomic updates, increments, array pushes, set additions and user-defined atomic operations to levelup.
level-atomics		Add (parallel) atomic operations like insert, replace, increment and decrement to levelup.
level-transactions		Transaction layer for levelup.

Jobs

Name	Dependencies	Description
level-schedule		A durable job scheduler.
level-jobs		Job Queue in levelup.
batchdb		levelup and disk storage for queued batch jobs.

File System

Name	Dependencies	Description
level-filesystem		Full implementation of the Node.js fs module on top of levelup.
browserify-fs		level-filesystem as drop-in fs replacement for the browser, to be used with browserify.
level-fs		Node's fs module with levelup as backend.
level-fs-browser		level-fs as drop-in fs replacement for the browser, to be used with browserify.
level-store		A streaming storage engine based on levelup.
level-serve		Streaming static file server based on levelup.
suckit		Expose a level-store over HTTP.
level-vinyl		Vinyl adapter and blob store. Saves file contents in a content addressable blob store, file metadata in levelup.
level-blob		Store blobs in levelup
level-blob-store		An abstract-blob-store using LevelDB as the storage backend
level-pull-blob-store		A pull-blob-store implementation backed by LevelDB.
level-server		Standalone LevelDB file server based on level-serve, multilevel and level-sublevel.

Utilities

Name	Dependencies	Description
level-codec		Encode keys, values and ltgte options. Used in encoding-down.
level-errors		Error types for levelup.
level-test		Easily run your level-* tests against all stores.
level-compose		Compose a database factory from abstract-leveldown and levelup layers.
level-exists		Check if a datum exists without reading its value.
level-move		Move a value to another key.
level-capped		Capped collections.
level-create		Insert a key if and only if it doesn't already exist
level-create-batch		Insert a batch of keys if and only if none of the keys already exist
level-modify		Modify an existing key in levelup. Uses level-lock. See also level-create and level-move.
level-random		Read values of random levelup keys.
level-shared-batch		Share batches and commit collectively
batchlevel		Batch all operations made on a levelup instance. Compatible with subleveldown.
ltest		Test function for levelup testing, based on level-test.
level-probe		Get the first record in a range, using an iterator or stream. NB. Not compatible with latest levelup.
autolevel		Automatically combine levelup with the right abstract-leveldown store for your configuration.
level-lazy-open		Lazily open a leveldown compatible backend.
changeset		Generate diff changesets for javascript objects, decomposing diffs into a series of puts and delete operations. The format is compatible with levelup batch operations. Useful to synchronize objects.
level-delete-range		Delete a range of keys from levelup.
levelup-defaults		Change the defaults settings on a levelup instance by returning a new levelup instance that uses the same abstract-leveldown but different options.
level-methods		Useful meta information about levelup methods.

Replication

Name	Dependencies	Description
level-2pc		A two-phase commit protocol.
level-couch-sync		Replicate from CouchDB to LevelDB.
level-master		Master-Slave replication for levelup.
level-merkle		Uses merkle-trees to replicate data sets. Data must be sets and currently, deletes are not supported.
level-replicate		Master-master replication with levelup. Implements scuttlebutt style handshake, syncs data, then replicates real time changes.
level-replicator		Master-master replication. Same goal as level-replicate but different approach.

Tools

CLI, GUI and web interfaces for exploring data.

Name	Dependencies	Description
lev2		A complete REPL & CLI for managing LevelDB instances
level-in		A simple command-line utility for writing data to LevelDB via levelup.
level-out		A simple command-line utility for reading LevelDB data via levelup.
level-key-list		Command-line tool for quickly printing a list of keys in a LevelDB database.
lev		A CLI REPL interface for LevelDB.
leveldb-repl		Super simple REPL for LevelDB. Supports filter globbing.
levelhud		LevelDB GUI with an interactive console.
levelweb		A LevelDB GUI. Includes simple data visualization tools.
level-cli		Interact with LevelDB on the command line.
level-explore		A terminal program to visualize LevelDB data. Early stages.
level-repair		CLI tool to repair a LevelDB.
leveldb-editor		Edit a LevelDB from the command line.
levelscan		LevelDB command line scanning utility
levelui		A LevelDB GUI based on atom-shell (now called Electron).

Benchmarking & Debugging

Name	Dependencies	Description
level-bench		Benchmark abstract-leveldown and levelup stores.
level-compare-forks		Run benchmarks on different level-forks and see how they compare.
level-log		Log all levelup operations, including method calls.
debugdown		Log all operations made on an abstract-leveldown compliant store. For node and browsers.
level-time		Log levelup operations and their duration.
level-dump		Dumps all values and/or keys of a levelup or level-sublevel instance to the console.
level-benchmarks		Run benchmarks against levelup-compatible engines

Resources

Applications

Applications and libraries that use Level modules under the hood.

Legacy

Modules that are deprecated, archived or superseded. Listed here for the historical record.

Contributing

Module and resource authors are welcome and encouraged to add an entry for their work via a pull request. To add a module, edit modules/*.json and run npm run awesome to update README.md.

Level/awesome is an OPEN Open Source Project. This means that:

Individuals making significant and valuable contributions are given commit-access to the project to contribute as they see fit. This project is more like an open wiki than a standard guarded open source project.

See the Contribution Guide for more details.

Donate

To sustain Level and its activities, become a backer or sponsor on Open Collective. Your logo or avatar will be displayed on our 28+ GitHub repositories and npm packages. 💖

Backers

Sponsors

License

MIT © 2017-present Contributors.