crowRedis

• I built my own small simple in-memory datastore like redis to learn how it works internally and how databases are built , it has set,get,del, transactions (multi/exec ),persistence(snapshots, AOF) , concurrency support for all things and concurrent transactions.

• For Data replication, check out dataReplication-1 branch

Blog-1

Blog-2

Features

• Key-Value Storage: Store and retrieve data as key-value pairs in the Redis server.

• Data Manipulation: Supports common Redis commands such as SET, GET, and DEL for data manipulation.

• TTL (Time to Live): Set TTL for keys to automatically expire and remove them from the database after a specified time.

• Atomic Increment and Decrement: Use INCR and DECR to increment and decrement integer values associated with keys.

• Transaction Support: Execute multi-step transactions using the MULTI, EXEC, and DISCARD commands.

• Append-Only File (AOF) Logging: Enable AOF for command logging and recovery. Recover data from the AOF file when the server restarts.

SET mykey myvalue             # Set a key-value pair
GET mykey                    # Retrieve the value for a key
INCR mycounter               # Increment a counter
DECR mycounter               # Decrement a counter
EXPIRE mykey 60              # Set a TTL for a key
MULTI                        # Start a transaction
SET key1 value1              # Add commands to the transaction
SET key2 value2
EXEC                         # Execute the transaction

Prerequisites

Before you can run crowRedis and the client, make sure you have the following prerequisites installed on your system:

• Python (3.x recommended)
• Socket library (should be included with Python

How To use this:

• After cloning , run the crowRedis.py file , its the server that will listen to all your requests.
• Then run the client.py file , its the client where you can write your queries like ex: set name myname , get name , del name.
• rest scripts are for benchmarks and logs and snapshot file will be created automatically

Benchmark Test

I compared crowRedis and postgressSQL and real Redis again each other for some parameters on same hardware to see what are the test results :

• plz don't that this seriously, cause I am comparing a relational database with a memory database, but I wanted to see how much is a RAM-based database faster a disk-based one.
• Also, real Redis use a very complex mechanism for set,get,del of data and, mine is way too simplistic, that's why it's doing so fast operations.
• I am also learning things and might do some stupid comparisons so plz forgive me , I will learn what I don't know and improve ✌️

Using the Redis Client(client.py)

SET key value - Set the value of a key.
Example:

SET mykey Hello

GET key - Get the value associated with a key.
Example:

GET mykey

Setting TTL (Time to Live) for a Key.

SET mykey 42 EX 60

Using INCR and DECR

# Increment a counter
INCR page_views

# Decrement a counter
DECR stock_count

DEL key - Delete a key and its associated value.
Example:

DEL mykey

SAVE - Save data to a snapshot file.
Example:

SAVE

MULTI - Start a transaction block.
Example:

MULTI

EXEC - Execute the commands in a transaction.
Example:

MULTI
SET key1 value1
SET key2 value2
EXEC

DISCARD - Discard the commands in a transaction.
Example:

MULTI
SET key1 value1
DISCARD

LPUSH key value1 [value2 ...] - Insert one or more values at the beginning of a list.
Example:

LPUSH mylist item1
LPUSH mylist item2 item3

RPUSH key value1 [value2 ...] - Append one or more values to the end of a list.
Example:

RPUSH mylist item4
RPUSH mylist item5 item6

LPOP key - Remove and return the first element from a list.
Example:

LPOP mylist

RPOP key - Remove and return the last element from a list.
Example:

RPOP mylist

LRANGE key start stop - Get a range of elements from a list.
Example:

LRANGE mylist 0 2

Once you have the client running, you can interact with the crowRedis server. Here's how the client works:

To send a Redis command, enter it at the prompt and press Enter.
To exit the client, type 'exit' and press Enter.
Transaction Support
You can also work with transactions using the following commands:

To start a transaction, enter 'MULTI'.
Enter the transaction commands one by one.
To execute the transaction, enter 'EXEC'.
To discard the transaction, enter 'DISCARD'.
The client will send these commands to the server and display the responses.

Data Persistence
crowRedis supports data persistence through snapshot files and an append-only file (AOF). It automatically saves data to a snapshot file at regular intervals and recovers data from the AOF file upon server startup.

Transactions
crowRedis allows you to group multiple commands into a transaction using the MULTI command. You can add commands to the transaction and then use EXEC to execute them or DISCARD to cancel the transaction.

List Operations
crowRedis supports list operations, including LPUSH, RPUSH, LPOP, RPOP, and LRANGE, allowing you to manipulate lists stored as values in the data store.