Daniël Tom

Binary Cookies CLI and Python library

Lint Databricks Lakeflow Declarative pipeline YAML/JSON configuration files

SQLModel helper class for upserting records.

This library can convert a pydantic class to a avro schema or generate python code from a avro schema.

DataKit is a browser-based data analysis platform that processes multi-gigabyte files locally. All processing happens in your browser - no data is sent to external servers.

No description provided.

Turn REST APIs into pyspark DataFrames with a single connector

No description provided.

Custom PySpark Data Sources

Lints / fixes pyspark sql strings using sqlfluff. Comes with precommit hooks

Python library for finding country based on city name using openai api

Pyspark Custom DataSource CBOR

<archived> Unity Catalog extension for Jupyter Lab

A Jupyter Kernel for DuckDB with Unity Catalog

Manage Unity Catalog tables with Pydantic Models

✨ A Pydantic to PySpark schema library

Proof-of-concept extension combining the delta extension with Unity Catalog

Benchmark MapType vs VariantType in Apache Spark

Migrate Databricks Unity Catalog to OSS Unity Catalog

Personal blog