Never generate another thumbnail again - image sizing on the fly for Laravel

Command line front end for longtail synchronization tool

Gcs fuse system, windows fuse system on top of the google cloud storage service, mount Gcs buckets and folder as local driver on you local windows host

An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

An Elastic Beat to ingest data from Google Cloud Storage

Python Open-source ETL tool for seamless data movement across PostgreSQL, MySQL, Redshift, BigQuery, S3, GCS, and CSV files, with yaml/json-based configuration.

A storage abstraction layer for Node.js that removes any difference among multiple public cloud storage services and local filesystems

Create nice directory listings for Google Cloud Storage buckets with javascript and HTML.

A google cloud storage reverse proxy. For hosting private static sites using google cloud storage.

(WIP) An Object Storage

An end-to-end data engineering project on github activities data

Serve GCS Bucket content anonymously from Windows, Linux and MacOS

A .NET library that provides an abstraction for virtual file systems, including built-in implementations.

A Python package to enrich Google Cloud Data Catalog Fileset Entries with tags.

Batch ETL pipeline project on GCP to load and transform daily flight data using Spark to update tables in BigQuery. The pipeline is automated using Airflow.

Using pachyderm as pipeline engine to serve "taxi chicago" machine learning models

An ETL Pipeline built over GCP and orchestrated by Mage, which involves Extracting Data from GCS Bucket, building Dimensional Model, loading the Data into BigQuery and a Looker Dashboard for further analysis.

A GUI based Web Scraper

Interacting with public cloud object storage

GKE IAM role and workload identity sample project

Airflow script that ingest data from API and upload it to gcs bucket

Ingesting NYC Yellow Taxi Data to GCP using Airflow running on Docker

Creating a robust and scalable data pipeline on Google Cloud Platform (GCP) to monitor and analyze stock performance. Leveraging the power of GCP's data processing and storage services, a comprehensive solution has been built to efficiently collect, process, and visualize stock data.

An ETL pipeline to move an uploaded flat file ffrom GCS, mask PII, store Big Query, and Create a report in Looker.

GCS Bucket with Terraform

Simplified blueprints for building data pipelines with Google Cloud Storage (GCS).

Using google functions/virtual machine to retrieve data from a API, store into GCS bucket and transfer to BigQuery

This is in order to add additional stocks data information using dbt.

Storage Automation

An automated data pipeline for NYC taxi trip data using an ETL workflow