I'm thinking of creating a small program for myself, which takes products from Amazon and similar pages. What would be the best way to get all the information about the product on the page? Beautiful soup? Will it be something that will be better? Btw I am using Python
If you have a general purpose library, like a beautiful soup scraper Are in search or will work.
Specifically, you want to take a look at that (which works well with Scrappy), which can make the process easier, do not forget to check that your experiment is Amazon Usage guidelines are within or not.
No comments:
Post a Comment