close

DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Apache Kafka in Data engineering
eden_wetende profile

Apache Kafka in Data engineering

#dataengineering #kafka
Image Image Image 6
Comments 1
1 min read
🧭System Design Roadmap for Data Engineers
sajjadrahman56 profile

🧭System Design Roadmap for Data Engineers

#database #dataengineering #systemdesign #beginners
Image Image Image 5
Comments
3 min read
Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar
ctrix profile

Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar

#postgres #dataengineering #docker #devops
Image Image 2
Comments
3 min read
💥 Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)
narayan_f8f2c91c99dfd33e6 profile

💥 Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)

#dataengineering #rust #python #performance
Image 1
Comments
2 min read
Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK
andreparis profile

Building a Production-Ready Data Lake: PostgreSQL to S3 with AWS DMS, Glue, and Athena using CDK

#aws #dataengineering #typescript #postgres
Comments
8 min read
(â…¡) A Complete Guide to Core Data Warehouse Design Standards: From Layers, Types to Lifecycle
seatunnel profile

(â…¡) A Complete Guide to Core Data Warehouse Design Standards: From Layers, Types to Lifecycle

#datascience #bigdata #datawarehouse #dataengineering
Comments
6 min read
Building Distributed Systems with Ray—Just Like Running a Restaurant
n451m profile

Building Distributed Systems with Ray—Just Like Running a Restaurant

#dataengineering #architecture #tutorial #ray
Image 1
Comments
7 min read
Synthetic Data for RAG: Safe Generation, Deduplication, and Drift-Aware Curation in 2025
kuldeep_paul profile

Synthetic Data for RAG: Safe Generation, Deduplication, and Drift-Aware Curation in 2025

#dataengineering #rag #testing #llm
Comments
10 min read
The State of Apache Iceberg v4 - October 2025 Edition
alexmercedcoder profile

The State of Apache Iceberg v4 - October 2025 Edition

#dataengineering #architecture #opensource #database
Image 1
Comments
6 min read
Data Automation: A Deep Dive
amit_c1055f9bc58d1019c6c3 profile

Data Automation: A Deep Dive

#bigdata #dataengineering #data #automation
Comments
5 min read
TikTok Data Engineer Full 3-Round Interview
net_programhelp_e160eef28 profile

TikTok Data Engineer Full 3-Round Interview

#interview #dataengineering #tutorial #career
Comments
4 min read
Why Data Partitioning Is Harder Than It Looks
dct_technology profile

Why Data Partitioning Is Harder Than It Looks

#webdev #database #programming #dataengineering
Image 1
Comments
2 min read
Part 2: Snowflake's Autonomous Future
taro_matsui_japan profile

Part 2: Snowflake's Autonomous Future

#dataengineering #ai #snowflake
Comments
8 min read
Collecting Africa’s Energy Insights:
evlyn_njagi_a32f3ab6c984 profile

Collecting Africa’s Energy Insights:

#dataengineering #data #automation #python
Image Image 3
Comments
4 min read
Making JSON Compression Searchable — SEE (Schema-Aware Encoding)
kodomonocch1 profile

Making JSON Compression Searchable — SEE (Schema-Aware Encoding)

#dataengineering #finops #cloud #compression
Image 1
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.