I'm scrapping a website but it only shows a portion of the website below, in which it shows more buttons Is there no way to see everything on the webpage through python?
The beautiful soup parses the returned HTML only, it does not execute the javascript, which is often used After loading or loading content, the content is modified to modify the existing webpage.
You will need to execute javascript, for which only one HTML parser is available. You need to use a browser originally. There are some Python packages to do this:
No comments:
Post a Comment