vemonet/Setup Apache Spark
Set up Apache Spark and add the command-line tools to the PATH.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| spark-version | Apache Spark version to install, see https://spark.apache.org/downloads.html | yes | — |
| hadoop-version | Hadoop version for the Spark binaries | no | 3 |
| scala-version | Scala version for the Spark binaries (optional). | no | — |
| spark-url | Directly provide the URL to download the Spark binaries compressed as .tgz | no | — |
| py4j-version | Py4J version used for the PYTHONPATH. | no | 0.10.9 |
| xmx | Max RAM passed to Spark options (-Xmx). | no | 2048M |
| xms | Min RAM passed to Spark options (-Xms). | no | 1024M |
| install-folder | Folder where to install Spark (will be automatically defined if not provided) | no | — |
| log-level | Log level passed to Spark options (info/debug/warn). | no | info |
Outputs
| name | description |
|---|---|
| spark-version | The installed Apache Spark version. |