[파이썬] Beautiful Soup 4 태그의 속성 값 가져오기

06 Sep 2023

beautiful soup

Beautiful Soup is a powerful Python library that is used for web scraping and parsing HTML and XML documents. One common task in web scraping is to extract the values of specific attributes from HTML tags.

In this blog post, we will explore how to use Beautiful Soup 4 to extract attribute values from HTML tags using Python.

Installation

First, you need to install Beautiful Soup library using pip:

pip install beautifulsoup4

Example HTML

To demonstrate how to extract attribute values, let’s consider the following HTML:

<html>
    <head>
        <title>My Web Page</title>
    </head>
    <body>
        <h1 class="header">Welcome to my web page</h1>
        <p id="content">This is the content of my web page</p>
        <a href="https://www.example.com">Click here</a>
    </body>
</html>

Extracting attribute values using Beautiful Soup

To extract attribute values from HTML tags using Beautiful Soup, follow these steps:

Import the necessary modules:

from bs4 import BeautifulSoup

Create a BeautifulSoup object by parsing HTML:

html = "<html>...</html>"  # Replace with your HTML content
soup = BeautifulSoup(html, 'html.parser')

Use the .find() method to find the tag containing the desired attribute:

tag = soup.find('tag_name', attrs={'attribute_name': 'attribute_value'})

Replace 'tag_name' with the HTML tag name you want to find, 'attribute_name' with the name of the attribute, and 'attribute_value' with the desired value of the attribute.

Get the attribute value using the .get() method:

value = tag.get('attribute_name')

Replace 'attribute_name' with the name of the attribute you want to extract.

Example code

Let’s use the example HTML mentioned earlier to extract the attribute values using Beautiful Soup:

from bs4 import BeautifulSoup

html = '''
<html>
    <head>
        <title>My Web Page</title>
    </head>
    <body>
        <h1 class="header">Welcome to my web page</h1>
        <p id="content">This is the content of my web page</p>
        <a href="https://www.example.com">Click here</a>
    </body>
</html>
'''

soup = BeautifulSoup(html, 'html.parser')

# Extract the attribute value of class from <h1> tag
h1_tag = soup.find('h1')
class_value = h1_tag.get('class')
print(f"Class value of <h1> tag: {class_value}")

# Extract the attribute value of id from <p> tag
p_tag = soup.find('p')
id_value = p_tag.get('id')
print(f"ID value of <p> tag: {id_value}")

# Extract the attribute value of href from <a> tag
a_tag = soup.find('a')
href_value = a_tag.get('href')
print(f"Href value of <a> tag: {href_value}")

Output:

Class value of <h1> tag: ['header']
ID value of <p> tag: content
Href value of <a> tag: https://www.example.com

As you can see, we successfully extracted the attribute values using Beautiful Soup 4 in Python.

That’s it! Now you know how to extract attribute values from HTML tags using Beautiful Soup 4 in Python.