article-extraction is a package that can be used to extract the article content from an HTML page.
Use poetry to install the library from GitHub.
poetry add "git+https://github.com/pmatigakis/article-extraction.git"
Extract the content of an article using article-extraction.
from urllib.request import urlopen
from articles.mss.extractors import MSSArticleExtractor
document = urlopen("https://www.bbc.com/sport/formula1/64983451").read()
article_extractor = MSSArticleExtractor()
article = article_extractor.extract_article(document)
print(article)