Share via

DataFrameNaFunctions Class

Definition

Namespace:
Microsoft.Spark.Sql
Assembly:
Microsoft.Spark.dll
Package:
Microsoft.Spark v1.0.0

Provides functionalities for working with missing data in DataFrame.

public sealed class DataFrameNaFunctions
type DataFrameNaFunctions = class
Public NotInheritable Class DataFrameNaFunctions
Inheritance
Object
DataFrameNaFunctions

Methods

Drop()

Returns a new DataFrame that drops rows containing any null or NaN values.
Drop(IEnumerable<String>)

Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.
Drop(Int32, IEnumerable<String>)

Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values in the specified columns.
Drop(Int32)

Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values.
Drop(String, IEnumerable<String>)

Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.
Drop(String)

Returns a new DataFrame that drops rows containing null or NaN values.
Fill(Boolean, IEnumerable<String>)

Returns a new DataFrame that replaces null or NaN values in specified boolean columns. If a specified column is not a boolean column, it is ignored.
Fill(Boolean)

Returns a new DataFrame that replaces null values in boolean columns with value.
Fill(Double, IEnumerable<String>)

Returns a new DataFrame that replaces null or NaN values in specified numeric columns. If a specified column is not a numeric column, it is ignored.
Fill(Double)

Returns a new DataFrame that replaces null or NaN values in numeric columns with value.
Fill(IDictionary<String,Boolean>)

Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,Double>)

Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,Int32>)

Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,Int64>)

Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,String>)

Returns a new DataFrame that replaces null values.
Fill(Int64, IEnumerable<String>)

Returns a new DataFrame that replaces null or NaN values in specified numeric columns. If a specified column is not a numeric column, it is ignored.
Fill(Int64)

Returns a new DataFrame that replaces null or NaN values in numeric columns with value.
Fill(String, IEnumerable<String>)

Returns a new DataFrame that replaces null or NaN values in specified string columns. If a specified column is not a string column, it is ignored.
Fill(String)

Returns a new DataFrame that replaces null or NaN values in numeric columns with value.
Replace(IEnumerable<String>, IDictionary<Boolean,Boolean>)

Replaces values matching keys in replacement map with the corresponding values.
Replace(IEnumerable<String>, IDictionary<Double,Double>)

Replaces values matching keys in replacement map with the corresponding values.
Replace(IEnumerable<String>, IDictionary<String,String>)

Replaces values matching keys in replacement map with the corresponding values.
Replace(String, IDictionary<Boolean,Boolean>)

Replaces values matching keys in replacement map with the corresponding values.
Replace(String, IDictionary<Double,Double>)

Replaces values matching keys in replacement map with the corresponding values.
Replace(String, IDictionary<String,String>)

Replaces values matching keys in replacement map with the corresponding values.

Applies to