Skip to main content
Version: v2.10.0

Create Job

Steps to Create a Job​

  1. Navigate to the Job Dashboard
  2. Click the + Job button above the Action tab
  3. You will be redirected to the New Job window

Create Job

Job Fields​

  • Job Name

    • Enter a unique name
    • Max length: 64 characters
    • Must be lowercase
    • Allowed symbols: -, _, @, .

  • Cluster

    • Select an available cluster assigned to your workspace

  • Job Type
    Choose based on your use case:

    • Jar – Requires: Class Name, Arguments
    • Python3 – Requires: Arguments
    • Raw Scala – Write code inline or upload a .scala file
    • SQL – Write queries inline or upload a .sql file

  • Path

    • Location of the executable or script
    • Managed via Dependency Repositories

Job Create

Advanced Options​

You can configure:

  • Packages – Add dependencies
  • JARs – Include external libraries
  • Repositories – Define dependency sources
  • Archives – Add compressed resources
  • Files – Attach supporting files
  • Spark Configs – Configure Spark properties
  • Driver Configs – Customize driver settings
  • Concurrent Runs – Control parallel executions

These options help customize job behavior, dependency management, and execution performance.

Advanced options