Skip to content

NEO_AKSA

  • Home
  • Personal Gallery
  • About me
  • Kids need help in China
  • Speed Dials

Tag: Airflow

Airflow Brief (vs ADF)

July 31, 2019neo_aksaBig Data, ETL&DWAirflow, data pipelineLeave a comment

Next Topic on the Schedule

1. An Airflow Demo
2. Spark Rapids to leverage GPU to acclerate ETL
3. Something new in Databricks Summit 2021
4. Use Kaflka to extract data from SQL Server to data lake
5. Time Series Anomaly Detection

Recent Posts

  • How to break down databricks DBU cost to the pipeline level
  • A real case of optimazing spark notebook
  • Some working performance/cost improvement tips applying to ADF and Databricks recently
  • First Glance on GPU Accelerated Spark
  • SCD II or Snapshot for Dimension

Tags

ADF android architecture Azure Azure Devops big data CFD CNN ConvLSTM Curriculum databricks data pipeline deep learning Delta Lake Django EDA Eiganvalue Eiganvector ELT etl GPU HPC kafka Linux LSTM machine learning math metadata-driven netflix NLP optimize PCA Power BI python raspberry pi Recommendation systems Shell spark SQL SERVER SSIS Tableau ubuntu virtualization WSL WSL2

Archives

  • January 2022
  • November 2021
  • August 2021
  • June 2021
  • April 2021
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • October 2020
  • July 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018

Categories

  • Big Data
  • Computer Science
  • ETL&DW
  • HPC
  • Linux
  • Machine Learning
  • Others
  • Programming
  • Stats
  • Visualization
  • What if

My Github

https://github.com/neoaksa

Proudly powered by WordPress | Theme: ZackLive by Zack.