d2jsp
Log InRegister
d2jsp Forums > Off-Topic > Computers & IT > Programming & Development > Webscraping
Add Reply New Topic New Poll
Member
Posts: 12,928
Joined: Mar 10 2008
Gold: 0.00
Sep 23 2022 05:37pm
Are we allowed to talk about them?

I need someone to point me towards the right direction of scraping information for a car parts website, I need to grab the part number and part type.
Member
Posts: 8,428
Joined: May 30 2008
Gold: 882.50
Sep 24 2022 03:53pm
What’s the site? These types of tasks are a lot easier if there is an API available
Member
Posts: 15,960
Joined: Nov 29 2008
Gold: 40.64
Oct 2 2022 06:22pm
I'm curious about this too. And attempted this once and gave up, but maybe you can learn from what i tried. I ended up trying and failing was a UserScipt written in JS and that runs with a web browser add-on / extension. The UserScript did work for grabbing specific text elements off a website, but I had no way to store that data locally due to security limitations of web browsers. So it wasn't going to work for my needs.

Plan B which I have not tried yet but looked promising was with Python. There is a guide here i intended to follow but haven't yet : https://realpython.com/beautiful-soup-web-scraper-python/
Go Back To Programming & Development Topic List
Add Reply New Topic New Poll