DEV Community

Cover image for BeautifulSoup: REPLACEMENT CHARACTER
YURII DE.
YURII DE.

Posted on • Updated on

BeautifulSoup: REPLACEMENT CHARACTER

#python #beautifulsoup

BeautifulSoup: Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER

Use UnicodeDammit, more https://www.crummy.com/software/BeautifulSoup/bs4/doc/#unicode-dammit

self.bs = BeautifulSoup(
    UnicodeDammit(
        content, 
        ["latin-1", "iso-8859-1", "windows-1251"]
    ).unicode_markup,
    "html.parser")
Enter fullscreen mode Exit fullscreen mode

Top comments (0)

Read next

kihuni profile image

Comprehensive Guide to Filtering in Django REST Framework (DRF) with a Real-World Example

kihuni -

abhiramp_2005 profile image

WHICH SUPERHERO ARE YOU????

Abhiram -

rym_michaut profile image

🎉 HacktoberFest 2024: How to Contribute & Win Exclusive Prizes? 🚀

Rym -

rickdelpo1 profile image

Interactive stock market S&P 500 line chart using Bokeh, Python, JS, Pyscript and a movable angle finder for Trend Line Analysis

Rick Delpo -