menu

login

Log in

Linear Algebra

Prob and Stats

Other math topics

Machine Learning

Dagster (NEW)

search

Search

Login

Unlock 100+ guides

menu

menu

search toc

close

Outline

Parameters Return Value Examples Getting the number of values in PySpark RDD

Comments

Log in or sign up

Cancel

Post

account_circle

exit_to_app

Sign out

search

keyboard_voice

close

Searching Tips

Search for a recipe:
"Creating a table in MySQL"

Search for an API documentation: "@append"

Search for code: "!dataframe"

Apply a tag filter: "#python"

Useful Shortcuts

/ to open search panel

Esc to close search panel

↑↓ to navigate between search results

⌘d to clear all current filters

⌘Enter to expand content preview

icon_star

Doc Search

icon_star

Code Search Beta

SORRY NOTHING FOUND!

mic

Start speaking...

Voice search is only supported in Safari and Chrome.

fullscreen_exit

Shrink

Navigate to

PySpark

147 guides

keyboard_arrow_down

Linear Algebra

Prob and Stats

Machine Learning

Other math topics

chevron_leftPySpark RDD

Method coalesce Method collect Method collectAsMap Method count Method countByKey Method filter Method first Method getNumPartitions Method glom Method keys Method map Method partitionBy Method reduceByKey Method repartition Method zip Method zipWithIndex

check_circle

Mark as learned

thumb_up

0

thumb_down

0

chat_bubble_outline

0

Comment

auto_stories Bi-column layout

settings

PySpark RDD | count method

schedule Aug 12, 2023

Last updated

local_offer

PySpark

Tags

tocTable of Contents

expand_more

Parameters Return Value Examples Getting the number of values in PySpark RDD

Master the mathematics behind data science with 100+ top-tier guides
Start your free 7-days trial now!

PySpark RDD's count(~) method returns the number of values in the RDD as an integer.

Parameters

This method does not take in any parameters.

Return Value

An integer (int).

Examples

Consider the following PySpark RDD:


        
        
            
                
                
                    rdd = sc.parallelize(["A","B","A","B"])
rdd.collect()
                
            
            ['A', 'B', 'A', 'B']

Here, we are using the parallelize(~) method to create a PySpark RDD.

Getting the number of values in PySpark RDD

To get the number of elements in the RDD, use the count() method:


        
        
            
                
                
                    rdd.count()
                
            
            4

robocat

Published by Isshin Inada

Edited by 0 others

Did you find this page useful?

thumb_up

thumb_down

Comment

Citation

Ask a question or leave a feedback...

Official PySpark Documentation

https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.RDD.count.html

thumb_up

0

thumb_down

0

chat_bubble_outline

0

settings

Enjoy our search

Hit / to insta-search docs and recipes!

Navigation

Contact us

Resources

Python Pandas MySQL Beautiful Soup Matplotlib NumPy PySpark

Community

Join our Discord

Join our newsletter for updates on new comprehensive DS/ML guides

|