big-data

7 posts

cloud-computing gpu big-data machine-learning apache-spark

Leveraging Spark 3 and NVIDIA’s GPUs to Reduce Cloud Cost by up to 70% for Big Data Pipelines

Ilay Chen2/21/2024

data-mesh big-data event-streaming stream-processing flink

Streaming SQL in Data Mesh

Netflix Technology Blog11/3/2023

data-governance data-science data-quality big-data data

From Big Data to Better Data: Ensuring Data Quality with Verity

Michael McPhillips10/3/2023

feature-store big-data real-time-analytics engineering machine-learning

Chronon — A Declarative Feature Engineering Framework

Nikhil Simha7/11/2023

big-data pyspark fugue machine-learning

Big Savings On Big Data

Anindya Saha4/11/2023

validation data-lake Airflow MySQL Infrastructure big-data hadoop data-quality

Balancing quality and coverage with our data validation framework

Alexey Sanko2/7/2023

distributed-computing spark gcp dataproc big-data

Tuning Spark Applications to Efficiently Utilize Dataproc Cluster

Aride Chettali6/3/2022