Hello,

Iam pretty new at programming, so any suggestion is welcomed. Ive been trying scrape some data of collections from different websites.

Problem A -> My script worked perfectly on my old computer (win XP), but on newer versions crashed with errors. When i went throug the script step by step worked as it should be... So the problem is that the web is not loaded completely. This is what i got to delay procedure until web page done and is working on old win xp.

While ie.ReadyState <> 4
DoEvents
Wend

then

while ie.busy loop

Also tried manual timer, but also with no succes-> Application.Wait(Now + #0:00:01#). then it fails with navigation to another web page.

Problem B -> Cant figure out how to go next page on search result, for example I put diablo into google search and then I want to go to page 2, 3,... ect.

Any help would be apreciated

for problem 2, just change the url.
if your page size is 10, then add &start=10 for page 2, &start=20 for page 3, etc

i am going to make your life a better place


HTML Agility Pack

Dapper




btw solunds like you need a Document_Completed event, which gets called when the page fully loads

This post was edited by t9x on Sep 23 2015 07:25am

Thanx

Is there any chance to scrap page with encoded URL? Ive tried decoding with this tool -> http://meyerweb.com/eric/tools/dencoder/ and everything makes sence. But if I encode that same code and put it into browser it wont find anything ^^.

I am also trying make it work throug browser form, but the main problem is, that they have decoded options at combo box.

Btw at web page that didnt have encoded URL I finally succeed.


Any help is apreciated :).

Is there any chance for revealing hidden string? I mean instead of price i get this symbol $.