Skip to content

Web scraping fails for an OpenAI documentation URL #18

Description

@ndhoanit1112

Web scraping fails for OpenAI documentation URL

Steps to Reproduce

from supadata import Supadata

supadata = Supadata(api_key="MY_API_KEY")

url = "https://platform.openai.com/docs/guides/image-generation"
web_content = supadata.web.scrape(url)

Expected Behavior

The scraper should successfully extract and return the content from the OpenAI documentation page.

Actual Behavior

The scraping operation fails with a keyword argument error during initialization.

Error Message

Scrape.init() got an unexpected keyword argument 'type'

SDK Version

1.3.1

Additional Information

This issue also reproduces in the Playground environment.

Image

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions