PySpark
keyboard_arrow_down 147 guides
chevron_leftPySpark SQL Functions
Method arrayMethod colMethod collect_listMethod collect_setMethod concatMethod concat_wsMethod countMethod count_distinctMethod countDistinctMethod date_addMethod date_formatMethod dayofmonthMethod dayofweekMethod dayofyearMethod element_atMethod explodeMethod exprMethod firstMethod greatestMethod instrMethod isnanMethod lastMethod leastMethod lengthMethod litMethod lowerMethod maxMethod meanMethod minMethod monthMethod regexp_extractMethod regexp_replaceMethod repeatMethod roundMethod splitMethod to_dateMethod translateMethod trimMethod upperMethod whenMethod year
check_circle
Mark as learned thumb_up
0
thumb_down
0
chat_bubble_outline
0
Comment auto_stories Bi-column layout
settings
PySpark SQL Functions | isnan method
schedule Aug 12, 2023
Last updated local_offer
Tags PySpark
tocTable of Contents
expand_more Master the mathematics behind data science with 100+ top-tier guides
Start your free 7-days trial now!
Start your free 7-days trial now!
PySpark SQL Functions' isnan(-) method returns True where the column value is NaN (not-a-number).
NOTE
PySpark treats null and NaN as separate entities. Please refer to our isNull(-) method for more details.
Parameters
1. col | string or Column object
The column label or Column object to target.
Return Value
A PySpark SQL Column object (pyspark.sql.column.Column).
Examples
Consider the following PySpark DataFrame:
import numpy as npdf = spark.createDataFrame([["Alex", 25.0], ["Bob", np.nan], ["Cathy", float("nan")]], ["name", "age"])
+-----+----+| name| age|+-----+----+| Alex|25.0|| Bob| NaN||Cathy| NaN|+-----+----+
To get all rows where age is NaN:
Published by Isshin Inada
Edited by 0 others
Did you find this page useful?
thumb_up
thumb_down
Comment
Citation
Ask a question or leave a feedback...
Official PySpark Documentation
https://spark.apache.org/docs/3.1.3/api/python/reference/api/pyspark.sql.functions.isnan.html
thumb_up
0
thumb_down
0
chat_bubble_outline
0
settings
Enjoy our search
Hit / to insta-search docs and recipes!
