ExecutionΒΆ Contents: Start a Spark Cluster How to run Spark jobs in Python Interactive session with pyspark Jupyter notebook Script execution with spark-submit How to to monitor Spark resource utilization Managed execution How to expose Spark metrics in Prometheus format Enable Prometheus metrics Scrape endpoints Write metrics to CSV files