After so many discussion, evaluation and testing, we finally launched a basic architecture for Azure cloud. I hid some key […]
September 23, 2019
Our new cloud architecture launched!
After so many discussion, evaluation and testing, we finally launched a basic architecture for Azure cloud. I hid some key […]
For a long term, I thought there was no pipeline concept in Databricks. For the most engineers they will write […]
Essentially, ADF(Azure Data Factory) only takes responsibility of Extraction and Load in the ELT pipeline. Then we have to use […]
Computer Science • ETL&DW • Programming
If you are a data scientist, you maybe never need to do the data preprocess work, like ETL/ELT, performance tunning […]
To load data from OLTP system to DW, we have to face a problem: how to balance time and cost. […]
ETL is the most common tool in the process of building EDW, of course the first step in data integration. […]