Quick Start

Stable Updated: January 13, 2017

  1. Install DC/OS Spark via the DC/OS CLI. Note: If you are using Enterprise DC/OS, you may need to follow additional instructions. See the Install and Customize section for more information.
    $ dcos package install spark
  2. Run a Spark job:
    $ dcos spark run --submit-args="--class org.apache.spark.examples.SparkPi https://s3.amazonaws.com/downloads.mesosphere.com/spark/assets/spark-examples_2.10-1.4.0-SNAPSHOT.jar 30"
  3. Run a Python Spark job:
    $ dcos spark run --submit-args="https://downloads.mesosphere.com/spark/examples/pi.py 30"
  4. View your job:

    Visit the Spark cluster dispatcher at
    http://<dcos-url>/service/spark/ to view the status of your job.
    Also visit the Mesos UI at http://<dcos-url>/mesos/ to see job logs.