A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

A Machine Learning System that work on prediciton of flight Delay to take action Based on it

Python / Automation – Automates job scraping by keyword and location, filters duplicates, and emails listings daily. Python scripting, web scraping, scheduling, and data pipeline development.

Data Engineering 101

This Ads Data Pipeline simulates and processes company and Google advertising data, calculating key performance metrics in real time. It stores the data in MongoDB, schedules regular updates, and saves processed statistics to CSV files for further analysis.

A DataFrame library inspired by Scio and Polars

IBM AI Engineering Specialization AI Capstone Project with Deep Learning

This repository includes a small project that includes main ML topics as a reference.

OBIX: Where Data Meets UI/UX

No description provided.

Repo that relates to the Medium blog 'Creating serverless data pipelines with Azure Functions and Azure Pipelines'

Data pipeline using Databricks asset bundle & dbt

Building a four-step data pipeline using Airflow to download podcast episodes.

🛒 Automate price monitoring across e-commerce sites, receive real-time alerts for drops, and generate detailed analytics with this efficient web scraping pipeline.