close

DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Securely Implementing Snowflake AWS Lambda Integration with Key Pair Authentication + Secrets Manager

Securely Implementing Snowflake AWS Lambda Integration with Key Pair Authentication + Secrets Manager

Image Image 3
Comments
5 min read
The Web Scraping Data Warehouse Pipeline I Run for $12/Month

The Web Scraping Data Warehouse Pipeline I Run for $12/Month

Comments
3 min read
CSV: The Format Nobody Designed

CSV: The Format Nobody Designed

Comments
2 min read
Stop Babysitting Servers: Build a Scalable Serverless Data Lake on AWS

Stop Babysitting Servers: Build a Scalable Serverless Data Lake on AWS

Comments
2 min read
CTEs vs Subqueries in SQL: Which One Should You Use?

CTEs vs Subqueries in SQL: Which One Should You Use?

Comments
3 min read
Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

Image 1
Comments 1
2 min read
🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

Comments
5 min read
Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Comments
8 min read
AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

Image Image Image 5
Comments
7 min read
Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Comments
3 min read
How to Install Github Desktop for Data Analysis Projects

How to Install Github Desktop for Data Analysis Projects

Comments
2 min read
Your Ruby CSV Import Ran Successfully — Your Data May Still Be Wrong

Your Ruby CSV Import Ran Successfully — Your Data May Still Be Wrong

Image 1
Comments
2 min read
Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

Comments
17 min read
Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

Real-time streaming pipeline with Apache Flink 2.0, Kafka and Iceberg

Comments
7 min read
Linux Fundamentals Every Beginner Data Engineer Should Know

Linux Fundamentals Every Beginner Data Engineer Should Know

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.