46 results for “topic:schema-evolution”
Flink CDC is a streaming data integration tool
Avro for JavaScript :zap:
Flamingock brings Change-as-Code (CaC) to your entire stack. It applies versioned, auditable changes to the external systems your application depends on — such as schemas, message brokers, databases, APIs, cloud services, and any other external system your application needs.
Provides utilities for Postgres database schema versioning.
A library for the creation, management, and installation of schema updates for relational databases.
Tools for schema evolution and language-integrated schemata
A PHP 8+ API client for the Confluent Schema Registry REST API based on Guzzle 7 - http://docs.confluent.io/current/schema-registry/docs/index.html
A Rust library for revision-tolerant serialisation and deserialisation, with support for schema evolution over time
Avro Schema Evolution made easy
SQL-first lifecycle toolkit for testing, inspecting, and evolving database applications.
Tesseract: Efficient Online Schema Evolution for Snapshot Databases (VLDB 2023)
An *open specification* multi-language, multi-protocol to describe your Data Protection rules and Personal Identifying Information as part of your schema
Kafka Schema Registry Spring Boot demo with Avro producer/consumer and PostgreSQL persistence
Monocle optics/lenses for Play! JSON
A Java serializer for evolving data-structures
This is a project aimed at creating an agent that perpetually thinks and develops itself. It can add entries into an SQLite database and change the structure of that databaase. It also has the ability to search the web when it needs to. It utilizes OpenAI function calling and the responses API. All that is needed to run it is an OpenAI API key.
Kafka Schema Evolution & Contract Enforcement demo with Avro, Schema Registry and Spring Kafka.
Demo - Schema evolution using Apache Avro and Google Protocol buffers
Apache Avro schema evolution example project
Database Migrations
Kafka SchemaRegistry and schema evolution at work
A small interactive map that visualizes meaning and schema drift across distributed systems over time.
A series of essays, diagrams, and small prototypes exploring how systems maintain truth, consistency, and coherence across events, services, and decisions.
An interactive boundary map that shows where a field crosses privacy, legal, or domain boundaries it shouldn’t — before data moves across systems.
Avro Deserialization with Schema Registry
A tiny prototype that checks two JSON events for simple schema or field inconsistencies (toy version).
An interactive tool that validates event routing rules and filtering logic before events ship, so you don’t silently drop or misroute events.
A small interactive tool that checks whether a JSON event meets field, naming, typing, and domain-quality rules.
In this project we'll create real time healthcare patient data pipeline as data source and use arious services and tools like Azure Eventhubs, Azure Databricks, Delta lake and synapse analytics. also, implement medallion architecture, schema evolution and create facts and dimension tables and connect the cleaned and transformed data to PowerBI.
Data lineage tracking and governance platform for ML pipelines with LGPD/GDPR compliance