Live lakehouse report
Job-Market Lakehouse
PySpark lakehouse over scraped job-market data with Bronze/Silver/Gold Parquet layers, incremental ingestion, skill extraction, data quality checks, role-level demand marts, and a static analytics report.
Inspect the generated Bronze/Silver/Gold report summary through the portfolio facade.
Python
PySpark
Parquet
DuckDB
Docker
Page expectations
What this route loads and what you should see.
Data source
Loads summary.json from the internal lakehouse report container.
Expected result
Shows source count, Bronze/Silver rows, Gold mart counts, and quality status.
Live lakehouse report summary
Inspect the generated Bronze/Silver/Gold report summary through the portfolio facade.
Shows source count, Bronze/Silver rows, Gold mart counts, and quality status.
Loading generated lakehouse report summary.