F1

RACE STRATEGY & TELEMETRY ANALYTICS

GCP Medallion Pipeline (OpenF1 → GCS → PySpark → BigQuery)

OpenF1 Gold Snapshot
Fastest Lap Leader
—
Fastest lap in selected race
Fastest Lap
—
Selected race
Field Pit Stops
—
Selected race
Processed Records
—
Gold analytics rows
Driver Pace & Strategy Overview
Calculated by PySpark Gold Aggregations.
Lap rank Driver Constructor Start Tyre Laps Fastest Lap Pit Stops
Tyre Pace Degradation Curves
Lap time decay as tyre age increases, split by compound stints.
Pit Stop & Tyre Stint Timeline
Proportional race tyre strategy by driver (Red = Soft, Yellow = Medium, White = Hard).
Track & Ambient Weather Conditions
Track and ambient weather observations for the selected race.
End-to-End GCP Medallion Pipeline Architecture
Designed following enterprise production data engineering best practices.

📥 1. Ingestion (Bronze)

  • OpenF1 REST API (7 endpoints)
  • Token bucket rate-limiter (30 RPM)
  • Exponential back-off retry logic
  • Raw JSON partitioned on GCS

⚡ 2. PySpark (Silver)

  • Schema enforcement & UTC timestamps
  • Deduplication on session/lap keys
  • Calculated tyre_life & lap durations
  • Snappy-compressed Parquet on GCS

📊 3. Analytics (Gold)

  • PySpark strategy aggregations
  • Partitioned & Clustered BigQuery tables
  • Tyre degradation delta curves
  • Loaded directly via GCS to BQ API

🌐 4. Presentation

  • Static dashboard served from Gold JSON
  • Deployable Web UI (Zero dependency)
  • Interactive Chart.js visualizations
  • Free hosting via GitHub Pages