README

BiSight ETL is a simple, extensible and powerful E(xtract), T(ransform), L(oad) application and library.

It provides a pluggable set of Extractors, Transformers and Loaders. New and/or custom extensions can be easily integrated by implementing one of the 3 interfaces.

What is ETL ?

According to Wikipedia

In computing, Extract, Transform and Load (ETL) refers to a process in database usage and especially in data warehousing that:

• Extracts data from homogeneous or heterogeneous data sources
• Transforms the data for storing it in proper format or structure for querying and analysis purpose
• Loads it into the final target (database, more specifically, operational data store, data mart, or data warehouse)

Docs

Read the docs at etl.readthedocs.org.

How to try?

Just run:

bin/try

and follow instructions.

TODO

• Standardize columns
• Ability to provide just names of extractors/loaders/transformers, not classes
• Make bin/publish shell script automating phar building and publishing process

Brought to you by the LinkORB Engineering team

Check out our other projects at engineering.linkorb.com.

Btw, we're hiring!