himadieievsv/redpulsar
Distributed locks and other utils, can be used with Jedis client and Lettuce client for Redis
RedPulsar
What is RedPulsar?
RedPulsar provides Distributed Locks with Redis and other utilities for cloud computing or different kinds of distributed systems.
It is minimalistic, lightweight, and easy to use library written in Kotlin and currently can be used with both Jedis or Lettuce clients.
Features
- Mutex: Distributed lock mechanism on a resource, that uses consensus of the majority of data storage nodes to determine if check obtained successfully.
- Semaphore: Distributed semaphore implementation allowing multiple number of lock on a resource. It also uses consensus of the majority of data storage nodes to determine if check obtained successfully.
- SimplifiedMutex: Simplified distributed lock mechanism on a resource. Unlike Mutex it uses single data storage node.
- ListeningCountDownLatch: Implementation of distributed Count Down Latch, it uses that uses consensus of the majority of data storage instances ensuring count down consistency.
ListeningCountDownLatch utilized Redis Pub/Sub mechanism to notify waiting workloads about count reaching zero.
Supporting data storages
Currently, RedPulsar supports Redis as a data storage. It can be used with both Jedis or Lettuce clients.
- See redpulsar-jedis module for details.
- See redpulsar-lettuce module for details. This module also provides convenient lettuce pooled clients.
Java compatibility
Minimal required Java version is 11.
RedPulsar project is written in Kotlin, but can be easily used in Java projects too.
Getting started
Gradle dependency:
implementation("com.himadieiev:redpulsar-jedis:1.4.0")
// OR
implementation("com.himadieiev:redpulsar-lettuce:1.4.0")- See Getting started with redpulsar-jedis for getting started with Jedis client.
- See Getting started with redpulsar-lettuce for getting started with Lettuce client.
Development
To build RedPulsar locally, you need to have JDK 11+ installed.
To build or test RedPulsar, run the following command:
git clone git@github.com:himadieievsv/redpulsar.git
cd redpulsar
# Code formatting
./gradlew ktlintFormat
# Run all tests
docker-compose up -d
./gradlew test
# Run only unit tests
./gradlew test -DexcludeTags="integration"
# Build
./gradlew build -x test
# Publish to local maven repository
./gradlew publishToMavenLocal \
-Psigning.secretKeyRingFile=... \
-Psigning.password=... \
-Psigning.keyId=...Further development
Extending RedPulsar to use other data stores
Currently, all features are implemented with Redis. However, it is possible to extend RedPulsar to use other distributed data stores like AWS DynamoDB / Casandra / ScyllaDB etc. Even it could be implemented with RDBMS like MySQL or PostgreSQL.
RedPulsar project have an abstraction level for data storage called Backend. See package com.himadieiev.redpulsar.core.locks.abstracts.backends for details what particular operation should be implemented.
New data storage should use a new module and implement same abstractions as current Redis implementations.
Contributing
Contributions are welcome! Please make sure to create Issue first before working on improvements o new features, feel free to submit a Pull Request from a project fork.
Furthers plans
- Add ListenerLock using Pub/Sub mechanism instead of polling.
- Add FairLock implementation. It supposed to be a lock that grants lock to the longest waiting thread.
- Leader election mechanisms.
- Service discovery service.
- etc.