- Published on
A complete, beginner-friendly walkthrough of a local Spark application: from compressed GitHub events to Bronze, Silver, and Gold data, with execution plans, jobs, stages, tasks, Parquet, joins, shuffle, skew, SQL, DataFrames, and a Streamlit dashboard.