Introduction

Introduction Hi, I’m Wen — a software engineer with three years of experience building data platforms and large-scale data systems in production. I specialize in Spark, data lakes, data streaming, validation, and visualization. I’ve worked across the full data pipeline, from ingesting real-time factory streaming data and batch processing to storing it in data warehouses, building Spark batch jobs, and surfacing aggregated data for Tesla’s cell manufacturing yield and financial reporting. ...