search
Search
Publish
menu
menu search toc more_vert
Robocat
Guest 0reps
Thanks for the thanks!
close
Comments
Log in or sign up
Cancel
Post
account_circle
Profile
exit_to_app
Sign out
help Ask a question
Share on Twitter
search
keyboard_voice
close
Searching Tips
Search for a recipe: "Creating a table in MySQL"
Search for an API documentation: "@append"
Search for code: "!dataframe"
Apply a tag filter: "#python"
Useful Shortcuts
/ to open search panel
Esc to close search panel
to navigate between search results
d to clear all current filters
Enter to expand content preview
icon_star
Doc Search
icon_star
Code Search Beta
SORRY NOTHING FOUND!
mic
Start speaking...
Voice search is only supported in Safari and Chrome.
Navigate to
A
A
share
thumb_up_alt
bookmark
arrow_backShare
Twitter
Facebook
thumb_up
0
thumb_down
0
chat_bubble_outline
0
auto_stories new
settings

Extracting all text from an element in Beautiful Soup

Programming
chevron_right
Python
chevron_right
Beautiful Soup
chevron_right
Cookbooks
chevron_right
Text Extraction Cookbook
schedule Mar 10, 2022
Last updated
local_offer PythonBeautiful Soup
Tags

To extract all text from an element in Beautiful Soup, use the get_text() method.

Examples

Consider the following HTML document:

my_html = """
   <div>
      <p>I like tea.</p>
      <p>I like <b>soup</b>.</p>
      I like soda.
   </div>
"""
soup = BeautifulSoup(my_html)

Extracting raw text

To extract all text:

print(soup.get_text())
I like tea.
I like soup.
I like soda.

Notice how you end up with awkward structure due to the spacings.

Extracting stripped text

To solve the problem of awkward spacings, add the strip=True parameter:

print(soup.get_text(strip=True))
I like tea.I likesoup.I like soda.

This looks much cleaner.

Specifying a separator

To join the bits and pieces of text using "**" as the separator:

print(soup.get_text("**", strip=True))
I like tea.**I like**soup**.**I like soda.

To explain the output, recall that our HTML document's middle line was as follows:

<p>I like <b>soup</b>.</p>

Each pair of opening and closing tags are replaced by your specified separator - that's all.

robocat
Published by Isshin Inada
Edited by 0 others
Did you find this page useful?
thumb_up
thumb_down
Ask a question or leave a feedback...