
        
        
            
                
                
                    from pyspark.sql import Row
row = Row(name="alex", age=25)
row
                
            
            Row(name='alex', age=25)

To convert this Row object into a dictionary:


        
        
            
                
                
                    row.asDict()
                
            
            {'name': 'Alex', 'age': 25}

Converting nested PySpark Rows into dictionaries

By default, recursive=False, which means that nested rows will not be converted into dictionaries:


        
        
            
                
                
                    from pyspark.sql import Row
row = Row(name="Alex", age=25, friends=Row(name="Bob", age=30))
row.asDict()   # recursive=False
                
            
            {'name': 'Alex', 'age': 25, 'friends': Row(name='Bob', age=30)}

To convert nested Row objects into dictionaries as well, set recursive=True like so:


        
        
            
                
                
                    from pyspark.sql import Row
row = Row(name="Alex", age=25, friends=Row(name="Bob", age=30))
row.asDict(True)
                
            
            {'name': 'Alex', 'age': 25, 'friends': {'name': 'Bob', 'age': 30}}

Published by Isshin Inada

Edited by 0 others

Did you find this page useful?

thumb_up

thumb_down

Comment

Citation

Ask a question or leave a feedback...

Official PySpark Documentation

https://spark.apache.org/docs/3.1.1/api/python/reference/api/pyspark.sql.Row.asDict.html

thumb_up

thumb_down

chat_bubble_outline

settings

Enjoy our search

Hit / to insta-search docs and recipes!