GitHunt
EV

evolution-gaming/kafka-flow

library for reliable processing records received from kafka

kafka-flow

Build Status
Coverage Status
Codacy Badge
Version
License: MIT

Microsite

https://evolution-gaming.github.io/kafka-flow

Scala 3 compatibility

Starting from version 6.1.0 all of the modules are cross-compiled to Scala 3 except kafka-flow-kafka-journal which doesn't support Scala 3 yet.

Setup

addSbtPlugin("com.evolution" % "sbt-artifactory-plugin" % "0.0.2")

lazy val version = "<version>" // see the latest one in the badge above or in Releases page 

libraryDependencies ++= Seq(
  "com.evolutiongaming" %% "kafka-flow" % version,
  // if you want to use Cassandra for storing persistent state
  "com.evolutiongaming" %% "kafka-flow-persistence-cassandra" % version,
  // if you want to use Kafka compact topic for storing persistent state
  "com.evolutiongaming" %% "kafka-flow-persistence-kafka" % version,
  // if you want to use predefined metrics
  "com.evolutiongaming" %% "kafka-flow-metrics" % version,
  // if you want to use kafka-journal integration
  "com.evolutiongaming" %% "kafka-flow-kafka-journal" % version,
)

Release process

The release process is based on Git tags and makes use of evolution-gaming/scala-github-actions which uses sbt-dynver to automatically obtain the version from the latest Git tag. The flow is defined in .github/workflows/release.yml.
A typical release process is as follows:

  1. Create and push a new Git tag. The version should be in the format vX.Y.Z (example: v4.1.0). Example: git tag v4.1.0 && git push origin v4.1.0
  2. On success, a new GitHub release is automatically created with a calculated diff and auto-generated release notes. You can see it on Releases page, change the description if needed
  3. On failure, the tag is deleted from the remote repository. Please note that your local tag isn't deleted, so if the failure is recoverable then you can delete the local tag and try again (an example of unrecoverable failure is successfully publishing only a few of the artifacts to Artifactory which means a new attempt would fail since Artifactory doesn't allow overwriting its contents)
MIT License
Created August 28, 2019
Updated March 13, 2026