Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

MOA is an open source framework for Big Data stream mining. It includes a collection of machine learning algorithms (classification, regression, clustering, outlier detection, concept drift detection and recommender systems) and tools for evaluation.

c++ LINQ -like library of higher-order functions for data manipulation

Dynatrace hash library for Java

Performant implementations of various streaming algorithms, including Count–min sketch, Top k, HyperLogLog, Reservoir sampling.

Learning M-Way Tree - Web Scale Clustering - EM-tree, K-tree, k-means, TSVQ, repeated k-means, bitwise clustering

Estimating k-mer coverage histogram of genomics data

t-digest module for Redis

Federated Principal Component Analysis Revisited!

Streaming operations on NumPy arrays

An online statistics library, written in Go

A Set of Streaming Algorithms in C++, Python, and Go

RiverText is a framework that standardizes the Incremental Word Embeddings proposed in the state-of-art. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

Streaming, Memory-Limited, r-truncated SVD Revisited!

Fast and Memory Efficient Genome Sketching via HyperLogLog, HyperMinHash and UltraLogLog

This is the codebase for Faucet, described in our manuscript: https://academic.oup.com/bioinformatics/article/34/1/147/4004871, by Roye Rozov, Gil Goldshlager, Eran Halperin, and Ron Shamir

Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Nonparametric Correlation (Bivariate)

A deterministic genomics engine with a compact memory footprint. Run whole-genome workloads in as little as 100 MB RAM. Built in Rust.

Must-read papers on streaming graph

This repository contains all the solutions of assignments, starter files and other materials related to this specialization.

A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister. 🎲

Create MPEG2-TS encapsulated stream-segments.

Python-Wrapper for Francesco Parrella's OnlineSVR C++ implementation with scikit-learn-compatible interface.

Preview large text files online

Approximate UniFrac via Weighted MinHash 🦀

Updating Singular Value Decomposition (SVD) for rank-1 perturbed matrix.

CoEuS: Community Detection via Seed-set Expansion on Graph Streams

Simulates a HTTP Adaptive Streaming (HAS) session based on a throughput pattern and video segment sizes.

Screamingly fast streaming indicators with C++ performance and Python simplicity.

[IEEE ICASSP 2023] "Robust Subspace Tracking with Contamination Mitigation via Alpha-Divergence". In 48th IEEE International Conference on Acoustics, Speech, & Signal Processing, 2023.