TA

tamanyan/digdag-embulk-server

Digdag Server for building Data Lake

bigquery digdag docker docker-compose embulk etl

Digdag Embulk Server

What is this project?

This project help you to create ETL Server.

Dependences

Digdag (v0.9.24)
Embulk (v0.9.7)

Requirements

Docker
Docker Compose

How to Develop

1. Copy .env.exmaple to .env and edit it

cp .env.example .env
vi .env # edit environment vars

2. Build images

docker-compose build

3. Run Digdag server on background

docker-compose up -d

Access http://localhost:65432/

docker-compose exec digdag bin/sh

On this page

Contributors

Created May 1, 2018

Updated October 7, 2018