A python 3 package to retrieve ambient air monitoring data from the United States Environmental Protection Agency’s (US EPA) Air Quality System (AQS) Data Mart API v2 interface

Data Mart As A Service

A R extension to retrieve EPA Air Quality System Data via the AQS Data Mart API

No description provided.

Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, largos de textos, máximos/mínimos de números y fechas, valores únicos y valores por default. También permite clasificar los campos en aplicabilidad de derechos ARCO para facilitar la implementación de leyes de protección de datos tipo GDPR, identificar los niveles de seguridad y si se está aplicando algún tipo de encriptación. Adicionalmente permite agregar reglas de validación más complejas sobre la misma tabla.

ETL process using Pentaho Data Integration (Kettle), for Sales and Purchases Datamarts from Adventureworks, as the final project from the Data Management course from the Big Data & Analytics Masters @ EAE class of 2021

A simple and extensible UI widget creation library for faster UI development.

This project is a Data Engineering solution implemented to validate the data types of columns in PostgreSQL tables in a DataMart. It aims to validate whether the data stored in tables conforms to the expected data types, improving data integrity and reliability.

This is the final project I had to do to finish my Big Data Expert Program in U-TAD in September 2017. It uses the following technologies: Apache Spark v2.2.0, Python v2.7.3, Jupyter Notebook (PySpark), HDFS, Hive, Cloudera Impala, Cloudera HUE and Tableau.

Projet BI – Client OLAP pour l’analyse et le pilotage du Datacenter d’ELIT (SONELGAZ). Ce projet inclut : un DataMart multidimensionnel, des cubes OLAP Mondrian, un client web pour l'analyse et le reporting, une automatisation ETL, un déploiement complet en Docker. Réalisé dans le cadre d’un PFE Master MIND (USTHB).

Getting Data from the SFPD dataset, integrating this data into a Datamart, and then proceed with the analysis through a dashboard

Transaction data analysis using Python.

Source code for the IDI Population Explorer, including SQL Server datamart and R Shiny front end

Example Project for DataVault and DataMart MSSQL

My solution to the iFood Data Architect Test using PySpark, Jupyter and Docker in order to create a local prototype data lake.

The National Information Management Facility (NIMF) is a centralised datamart design that is used to consolidate fisheries data from various operational systems.

This repository presents a data pipeline from a fictitious company with two endpoints: a Data Warehouse and a Data Mart. The focus of the project is to use Pentaho and Dimensional Modeling.

Project for building a ETL pipeline

SQL Case Studies with Details

Automated data extraction using APIs, AWS functions to build ETL pipelines, and data modeling in SSIS. Performed data manipulation, profiling, cleansing, integration, and price history tracking.

Repository for tutorials, information and notes on technology in general.

datamart scripts - molap (Data Science)

The data warehouse created consists of 2 data marts which can be used to find the analyse the sales for a company.

Olist 이커머스 공개 데이터를 활용해 매출·고객·배송 지표를 구조화하고, 비즈니스 관점에서 인사이트를 도출하기 위한 Streamlit 분석 대시보드입니다.

Building a Data Warehouse for Fudgemart Inc. by Integrating Data from two Subsidiaries to support Business Intelligent

dimensional modeling of AdventureWorks2017 for sales, creating a DataMart. It includes an ETL pipeline that loads the data from AdventureWorks2017 to AdventureWorksDM using SQL Server Integration Services (SSIS) and implements Slowly Changing Dimension (SCD) handling using the SCD wizard and Merge statement.

Desafio Técnico Gaudium: Modelagem Dimensional usando PySpark e SparkSQL.

Business Intelligence and Data Warehousing.

Example Project for Dimensional and Mart Databricks

Export from Odoo reports Datamart for BAT Argentina