An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

A distributed and highly available URL Shortener built on MERN stack, using Apache Zookeeper, cached using Redis, containerized by Docker.

End-to-end data engineering pipeline with various technologies to ingest real time data.

Dockerfiles & YAML definitions for Apache Drill

Zookeeper docker container, ready for deployments on kubernetes and openshift

Proof of concept open source Amazon Athena

Helm Charts to Deploy Apache Drill on Kubernetes

Thesis project: topic categorization and sentiment analysis on twitter with Apache Spark

Fully Managed Apache Zookeeper Cluster with Ansible & Terraform.

A Smart Traffic Management System for Ho Chi Minh City, Vietnam leveraging batch and real-time data processing, intuitive dashboards, and monitoring tools to optimize traffic flow, enhance safety, and support sustainable urban mobility through advanced analytics and user-friendly applications.

Big data sentiment analysis pipeline using Apache Kafka, Spark Streaming, and HBase. Demonstrates ingestion and real-time processing of Twitter streams, basic sentiment scoring, and persistent storage for querying and visualization.

A Visual Studio Code extension for managing Apache Zookeeper

Real time streaming of a time series with corresponding forecasts.

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for seamless deployment and scalability.

A demonstration with Spring Batch framework, Kafka, and PostgreSQL

Apache Drill and Apache Zookeeper helm charts for kubernetes

A real-time, dockerized Kafka event processor pipeline (utilizing an Apache Storm topology). The project is running in AWS with automated infrastructure deployment and execution, using Ansible.

Distributed Java Applications at Scale, Parallel Programming, Distributed Computing

An Ansible role which installs and configures Apache Zookeeper on Redhat/Debian based hosts

Dockerfile for Ubuntu 16.04 with Oracle Java 9 and Zookeeper from Ubuntu packages

Docker image packaging for Apache Zookeeper

Apache Zookeeper Metric Collector

URL shortener demo app using React, Node.js, Redis, MongoDB, Apache ZooKeeper, Nginx and Docker

URL shortener app using React, Node.js, Redis, MongoDB, Apache ZooKeeper, Nginx and Docker

A realtime ingestion and profiling engine for fast data.

Docker image for Apache Kafka and Zookeeper

Dockerfile for Ubuntu 16.04 with Oracle Java 8 and Zookeeper from Ubuntu packages

It contains the manifest to demo the watch feature of the zookeeper.

A look at the Apache ZooKeeper coordination service for distributed services including distributed messaging brokers with kafka and a distributed search engine using TF-IDF Algorithm

Distributed Message Queue