d2jsp
Log InRegister
d2jsp Forums > Off-Topic > Computers & IT > Programming & Development > Does D2jsp Have An Api?
Add Reply New Topic New Poll
Member
Posts: 4,157
Joined: Apr 28 2012
Gold: 0.00
Jan 16 2017 04:03am
Would love to extract some data on posts, and maybe share some insights with the community.
Member
Posts: 8,110
Joined: Sep 23 2006
Gold: 3,558.23
Jan 16 2017 08:32am
Quote (Nickels @ Jan 16 2017 05:03am)
Would love to extract some data on posts, and maybe share some insights with the community.


Don't think so. Be careful though. If I remember correctly, the last person to scrape jsp took it offline for a little while and was subsequently banned.
Member
Posts: 36,123
Joined: Jul 18 2008
Gold: 2,407.00
Jan 16 2017 02:21pm
I doubt njag would create one.
Member
Posts: 13,425
Joined: Sep 29 2007
Gold: 0.00
Warn: 20%
Jan 16 2017 03:52pm
Quote (Qord @ Jan 16 2017 10:32am)
Don't think so. Be careful though. If I remember correctly, the last person to scrape jsp took it offline for a little while and was subsequently banned.


He was doing it wrong then.
Member
Posts: 4,157
Joined: Apr 28 2012
Gold: 0.00
Jan 17 2017 06:38am
Quote (Mastersam93 @ Jan 16 2017 01:21pm)
I doubt njag would create one.


Why? Just purely because there is no immediate $$$ value in scheduling such work?
Member
Posts: 36,123
Joined: Jul 18 2008
Gold: 2,407.00
Jan 17 2017 07:12am
Quote (Nickels @ Jan 17 2017 07:38am)
Why? Just purely because there is no immediate $$$ value in scheduling such work?



Just the way he goes about running the site. He seems like he likes to have things under his control, I don't think he'd want people scraping it.
Member
Posts: 3,197
Joined: May 4 2013
Gold: 1,457.00
Jan 19 2017 10:48am
Quote (Mastersam93 @ Jan 17 2017 06:12am)
Just the way he goes about running the site. He seems like he likes to have things under his control, I don't think he'd want people scraping it.


Nothing stops people from scraping the site. It's not hard, eg. ruby + mechanize.

Well, API would stop people from scraping... because they would just use API
Member
Posts: 29,537
Joined: Apr 30 2006
Gold: 87.69
Feb 14 2017 09:50am
Just scrape what you're interested in.

http://d2jsp.org/robots.txt
Go Back To Programming & Development Topic List
Add Reply New Topic New Poll