profile picture
Allan Corrêa

Data Engineer & Technical Lead
Microsoft Fabric · Databricks · Azure

Chat on WhatsApp Book a call →
  • © Allan Corrêa 2026
  • Home
  • Blog
  • Services
  • About
Case Study #4: Data Quality Beyond Null Checks — Building a Proactive Monitor for Production Pipelines

Case Study #4: Data Quality Beyond Null Checks — Building a Proactive Monitor for Production Pipelines

April 3, 2026 · 3 min read

How a team stopped discovering data problems from business complaints and started catching them before anyone woke up.

Read more →
Case Study #3: Building a Metadata-Driven Ingestion Pipeline — 85 Tables, One Framework

Case Study #3: Building a Metadata-Driven Ingestion Pipeline — 85 Tables, One Framework

March 11, 2026 · 3 min read

How a single configurable framework replaced what would have been dozens of individual pipelines.

Read more →
Case Study #2: From 14 Hours to 6 — Diagnosing a PySpark Performance Problem

Case Study #2: From 14 Hours to 6 — Diagnosing a PySpark Performance Problem

February 14, 2026 · 3 min read

How reading the Spark UI before touching any code led to a 57% reduction in pipeline runtime.

Read more →
Case Study #1: When Virtualizing a Layer Was the Right Call

Case Study #1: When Virtualizing a Layer Was the Right Call

January 17, 2026 · 3 min read

How questioning a standard architectural practice dropped capacity consumption from 85% to 35%.

Read more →
  • © Allan Corrêa 2026