I need to make a script that counts the word occurrences on the web pages

what I'm doing is calculating random IPs (avoiding checking the same ips more than once), using nmap to see if the port 80 is open to know if it's a web server and then I use w3m to make the http page as file.
After it's easy to count the word occurances

I got a few questions and problems

- This process takes A LOT, but I can't think any method to make it quicker
- Many of the ips with the port 80 open aren't web sites, they aren't up and they might have some problems, is there any ways to check only the sites that are up?
- this method only check the word occurrences in the index page of a web site, is there a way to check also the other public pages?

thanks a lot

well basically the biggest problem I have is that many domains can refer to the same IP adress.
I'm try to resolve a reverse ip lookup with some commands like dig, nslookup or host, but they all give me one PTR name

is there any ways to get in bash all the domains that refer to an IP adress?

actually telling people what you're really trying to do may go a long way in actually getting help.