Spin up a REST API for any Major Database

My personal project for data engineering zoomcamp

This utilizes a static IP address in GCP to pull data from the Clash of Clans API, store it and serve it via data studio. There is also a API client with a sleep of functions you can use to pull, store, and view CoC facts and dimensions.

Automatically load data from Google Cloud Storage files into Big Query tables

In this project, I am trying to predict traffic congestion, based on an aggregate measure of stopping distance and waiting times, at intersections in 4 major US cities: Atlanta, Boston, Chicago & Philadelphia.

An end-to-end, serverless AI platform built on Google Cloud that automatically ingests and analyzes financial data to generate actionable trading signals for the Russell 1000. This repository contains the full data pipeline that powers the ProfitScout application.

Easy-to-use Python library for managing files and data in different environments

A platform for users to upload and share the responses from law enforcement agencies to their traffic violation reports in Taiwan. This system aims to increase transparency and public oversight of traffic law enforcement.

Explore efficient big data matching techniques

Facebook Ads dbt-BigQuery package

🍉 Repo for analytics engineering with dbt, transforming raw data into actionable insights.

Scripts used for analyzing GitHub commit locations to create a map visualization

Master of Applied Data Science - Milestone I Project (San Francisco Bike Sharing)

Data ingestion from Google BigQuery to PostgreSQL

Google Data Analytics Capstone Case Study (SQL and Tableau)

Native desktop BigQuery client built with Go, supporting multiple projects, schema explorer, fuzzy search, history, favorite queries, AI assistant

No description provided.

Copy table from one dataset to another in google big query using bash script

Segmentação de clientes baseada na avaliação de risco de inadimplência.

ETL pipeline with pyspark in Google Cloud Platform (GCP) using infrastructure-as-code principles with Terraform

Market Data Ingestion and BigQuery Integration project

Media sentiment analysis following the Israel-Hamas escalation in 2023

Analysed SEVIR and Storm Datasets and visualized the data using Big Query on Data Studio. Datasets: Sevir Data: The Storm EVent ImagRy (SEVIR) dataset is a collection of temporally and spatially aligned images containing weather events captured by satellite and radar. Visualized using Big Query and Data Studio.

Repo for queries written to run on Big Query for a data analytics project.

A repo containing auto-triggered Airflow ETL activities for datasets located on GCP storage that flattens and creates analytical views on Big Query

E-commerce supply chain analysis.

Webscraping dos dados do site Mercado Livre. Esses dados são exportados para uma base de dados BigQuery e algumas informações relevantes são obtidas através de consultas SQL.

Import Matomo API Live.getLastVisitsDetails data to Google BigQuery

Advanced SQL Course By Kaggle

Objective: Perform market analysis on Iowa liquor stores using State of Iowa alcoholic records, US census, US geological GIS data.