Share via

SparkSection Class

  • Reference

Defines Spark settings to use for the PySpark framework in the environment.

This SparkSection class is used in the Environment class.

Class SparkSection constructor.

Constructor

SparkSection(**kwargs)

Variables

Name Description
repositories
list

A list of Spark repositories.
packages
list

The packages to use.
precache_packages
bool

Indicates Whether to precache the packages.