d2jsp
Log InRegister
d2jsp Forums > Off-Topic > Computers & IT > Programming & Development > Java - Open A Url To Get Page Source
Prev12
Closed New Topic New Poll
Retired Moderator
Posts: 21,073
Joined: Apr 7 2008
Gold: 5,135.90
Trader: Trusted
Jan 8 2014 07:53am
Quote (carteblanche @ 7 Jan 2014 17:57)
it's likely a flood control. that's what youtube's api does. by time you wait a few seconds to try again it's all fixed up.


This was it. I set a 1 minute sleep after it checked 20 pages and then it worked fine.

Entire things is up and running now. I am going to explore Selenium like suggested as it might be something good to learn for projects down the road. I ended up writing a script that converts all of the summoner names to urls and then saved the sheet as a csv so that I don't have to use the apache poi. Will have to mess around a bit more as I would like to eventually write the changes it finds directly back into the file so that I just need to upload it again

Thanks for your help everyone :)
Retired Moderator
Posts: 18,570
Joined: Feb 27 2004
Gold: 11,858.00
Trader: Trusted
Jan 8 2014 09:31pm
Quote (Kagura @ Jan 8 2014 07:53am)
This was it. I set a 1 minute sleep after it checked 20 pages and then it worked fine.

Entire things is up and running now. I am going to explore Selenium like suggested as it might be something good to learn for projects down the road. I ended up writing a script that converts all of the summoner names to urls and then saved the sheet as a csv so that I don't have to use the apache poi. Will have to mess around a bit more as I would like to eventually write the changes it finds directly back into the file so that I just need to upload it again

Thanks for your help everyone :)


Opened this just so I could say I told you to do that in the first place.

Just saying.
Go Back To Programming & Development Topic List
Prev12
Closed New Topic New Poll