Object

org.apache.spark.sql.SQLImplicits

All Implemented Interfaces:: Serializable, EncoderImplicits, LowPrioritySQLImplicits

public abstract class SQLImplicits extends Object implements EncoderImplicits, Serializable

A collection of implicit methods for converting common Scala objects into Datasets.

Since:

1.6.0

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type

Class

Description

class

SQLImplicits.StringToColumn

Converts $"col name" into a Column.
Constructor Summary

Constructors

Constructor

Description

SQLImplicits()
Method Summary

Modifier and Type

Method

Description

abstract <T> DatasetHolder<T>

localSeqToDatasetHolder(scala.collection.immutable.Seq<T> s, Encoder<T> evidence$1)

Creates a Dataset from a local Seq.

Encoder<boolean[]>

newBooleanArrayEncoder()

Encoder<scala.collection.immutable.Seq<Object>>

newBooleanSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

Encoder<byte[]>

newByteArrayEncoder()

Encoder<scala.collection.immutable.Seq<Object>>

newByteSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

Encoder<double[]>

newDoubleArrayEncoder()

Encoder<scala.collection.immutable.Seq<Object>>

newDoubleSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

Encoder<float[]>

newFloatArrayEncoder()

Encoder<scala.collection.immutable.Seq<Object>>

newFloatSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

Encoder<int[]>

newIntArrayEncoder()

Encoder<scala.collection.immutable.Seq<Object>>

newIntSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

Encoder<long[]>

newLongArrayEncoder()

Encoder<scala.collection.immutable.Seq<Object>>

newLongSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

Encoder<short[]>

newShortArrayEncoder()

Encoder<scala.collection.immutable.Seq<Object>>

newShortSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

Encoder<String[]>

newStringArrayEncoder()

Encoder<scala.collection.immutable.Seq<String>>

newStringSeqEncoder()

Deprecated.
Use newSequenceEncoder instead.

abstract <T> DatasetHolder<T>

rddToDatasetHolder(RDD<T> rdd, Encoder<T> evidence$2)

Creates a Dataset from an RDD.

ColumnName

symbolToColumn(scala.Symbol s)

An implicit conversion that turns a Scala Symbol into a Column.

Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.EncoderImplicits
newArrayEncoder, newBooleanEncoder, newBoxedBooleanEncoder, newBoxedByteEncoder, newBoxedDoubleEncoder, newBoxedFloatEncoder, newBoxedIntEncoder, newBoxedLongEncoder, newBoxedShortEncoder, newByteEncoder, newDateEncoder, newDoubleEncoder, newDurationEncoder, newFloatEncoder, newInstantEncoder, newIntEncoder, newJavaDecimalEncoder, newJavaEnumEncoder, newLocalDateEncoder, newLocalDateTimeEncoder, newLongEncoder, newMapEncoder, newPeriodEncoder, newProductArrayEncoder, newProductSeqEncoder, newScalaDecimalEncoder, newSeqEncoder, newSequenceEncoder, newSetEncoder, newShortEncoder, newStringEncoder, newTimeStampEncoder

Methods inherited from interface org.apache.spark.sql.LowPrioritySQLImplicits
newProductEncoder

Constructor Details
- SQLImplicits
  
  public SQLImplicits()
Method Details
- localSeqToDatasetHolder
  
  public abstract <T> DatasetHolder<T> localSeqToDatasetHolder(scala.collection.immutable.Seq<T> s, Encoder<T> evidence$1)
  
  Creates a Dataset from a local Seq.
  
  Parameters:
  
  s - (undocumented)
  
  evidence$1 - (undocumented)
  
  Returns:
  
  (undocumented)
  
  Since:
  
  1.6.0
- newBooleanArrayEncoder
  
  public Encoder<boolean[]> newBooleanArrayEncoder()
  
  Specified by:
  
  newBooleanArrayEncoder in interface EncoderImplicits
- newBooleanSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<Object>> newBooleanSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newBooleanSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- newByteArrayEncoder
  
  public Encoder<byte[]> newByteArrayEncoder()
  
  Specified by:
  
  newByteArrayEncoder in interface EncoderImplicits
- newByteSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<Object>> newByteSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newByteSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- newDoubleArrayEncoder
  
  public Encoder<double[]> newDoubleArrayEncoder()
  
  Specified by:
  
  newDoubleArrayEncoder in interface EncoderImplicits
- newDoubleSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<Object>> newDoubleSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newDoubleSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- newFloatArrayEncoder
  
  public Encoder<float[]> newFloatArrayEncoder()
  
  Specified by:
  
  newFloatArrayEncoder in interface EncoderImplicits
- newFloatSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<Object>> newFloatSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newFloatSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- newIntArrayEncoder
  
  public Encoder<int[]> newIntArrayEncoder()
  
  Specified by:
  
  newIntArrayEncoder in interface EncoderImplicits
- newIntSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<Object>> newIntSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newIntSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- newLongArrayEncoder
  
  public Encoder<long[]> newLongArrayEncoder()
  
  Specified by:
  
  newLongArrayEncoder in interface EncoderImplicits
- newLongSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<Object>> newLongSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newLongSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- newShortArrayEncoder
  
  public Encoder<short[]> newShortArrayEncoder()
  
  Specified by:
  
  newShortArrayEncoder in interface EncoderImplicits
- newShortSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<Object>> newShortSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newShortSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- newStringArrayEncoder
  
  public Encoder<String[]> newStringArrayEncoder()
  
  Specified by:
  
  newStringArrayEncoder in interface EncoderImplicits
- newStringSeqEncoder
  
  public Encoder<scala.collection.immutable.Seq<String>> newStringSeqEncoder()
  
  Deprecated.
  Use newSequenceEncoder instead. Since 2.2.0.
  
  Specified by:
  
  newStringSeqEncoder in interface EncoderImplicits
  
  Returns:
  
  (undocumented)
- rddToDatasetHolder
  
  public abstract <T> DatasetHolder<T> rddToDatasetHolder(RDD<T> rdd, Encoder<T> evidence$2)
  
  Creates a Dataset from an RDD.
  
  Parameters:
  
  rdd - (undocumented)
  
  evidence$2 - (undocumented)
  
  Returns:
  
  (undocumented)
  
  Since:
  
  1.6.0
- symbolToColumn
  
  public ColumnName symbolToColumn(scala.Symbol s)
  
  An implicit conversion that turns a Scala Symbol into a Column.
  
  Parameters:
  
  s - (undocumented)
  
  Returns:
  
  (undocumented)
  
  Since:
  
  1.3.0

Class SQLImplicits

Nested Class Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Methods inherited from interface org.apache.spark.sql.EncoderImplicits

Methods inherited from interface org.apache.spark.sql.LowPrioritySQLImplicits

Constructor Details

SQLImplicits

Method Details

localSeqToDatasetHolder

newBooleanArrayEncoder

newBooleanSeqEncoder

newByteArrayEncoder

newByteSeqEncoder

newDoubleArrayEncoder

newDoubleSeqEncoder

newFloatArrayEncoder

newFloatSeqEncoder

newIntArrayEncoder

newIntSeqEncoder

newLongArrayEncoder

newLongSeqEncoder

newShortArrayEncoder

newShortSeqEncoder

newStringArrayEncoder

newStringSeqEncoder

rddToDatasetHolder

symbolToColumn