d2jsp
Log InRegister
d2jsp Forums > Off-Topic > Computers & IT > Programming & Development > Best Tools For The Job? > Lmk What You Think
Add Reply New Topic New Poll
Member
Posts: 23,337
Joined: Nov 2 2006
Gold: 7,528.30
Dec 19 2014 08:09pm
So I decided on a small project for myself: GUI automation and web scrapper/screen scrapper

All the program will need to do is read the state of the screen to determine what it needs to do next. The web scrapper will be the last inclusion. So coming from using a lot of java recently, I looked at my options for writing this and came up with:

Sikuli
AutoIT script
Java's Robot class
...learn c++

It's intended to be a short and sweet project that maybe can be built on, so I didn't want to learn c++
Autoit seems like the simplest way to go about it, but I'd prefer to get practice in python / Jython or whatever else as opposed to this

Reasonable or?
Member
Posts: 62,204
Joined: Jun 3 2007
Gold: 9,039.20
Dec 19 2014 09:16pm
Python, scrapy, and, selenium
Member
Posts: 23,337
Joined: Nov 2 2006
Gold: 7,528.30
Dec 19 2014 11:36pm
Quote (killg0re @ Dec 19 2014 09:16pm)
Python, scrapy, and, selenium


Thanks, I'll check it out.
Member
Posts: 62,204
Joined: Jun 3 2007
Gold: 9,039.20
Dec 21 2014 02:54am
If you're on Mac you could wrap Python around the system JavaScript or applescript, which would work similarly to windows autoit
Member
Posts: 62,204
Joined: Jun 3 2007
Gold: 9,039.20
Dec 21 2014 03:51am
Quote (killg0re @ Dec 21 2014 02:54am)
If you're on Mac you could wrap Python around the system JavaScript or applescript, which would work similarly to windows autoit


Here is the library I was thinking of, https://github.com/jacexh/pyautoit
Member
Posts: 23,337
Joined: Nov 2 2006
Gold: 7,528.30
Dec 22 2014 02:11pm
python and scrapy sound great. I was learning python before java
Member
Posts: 62,204
Joined: Jun 3 2007
Gold: 9,039.20
Dec 23 2014 12:01am
Member
Posts: 17,651
Joined: May 22 2009
Gold: 0.00
Dec 29 2014 07:24pm
i thought you could scrape the web with just php. but what do you mean exactly when you say "web scraper"
Go Back To Programming & Development Topic List
Add Reply New Topic New Poll