Sam - September 17, 2018
ProxyRack WHOIS Tool is a multi-threaded, socks5 proxy supported NodeJS application that can be used to scrape WHOIS record data or check domain availability.
Features
SOCKS proxy support with or without user credentials
Multi-threaded
Web UI and CLI
Optional: MongoDB to store results
ProxyRack WHOIS Tool requires node >=8.93
Quick node installation (multiple OS) https://github.com/creationix/nvm
Install the dependencies and devDependencies and start the web UI server.
$ git clone https://github.com/proxyrack/whois-proxy-scraping-tool.git
$ cd whois-proxy-scraping-tool
$ npm install
$ node index.js --mode server --port 8080 --web-port 8000
For CLI:
$ node index.js --mode file --input domains.txt --output result.txt --output-available available.txt --output-registered registered.txt
Proxies are stored in a JSON file called proxies.json
{
"proxies": [
"yourusername:yourpassword@megaproxy.rotating.proxyrack.net:222 socks5"
]
}
Example proxy included is from www.proxyrack.com
service
You can modify your MongoDB settings here, proxies file path, results directories and set the number of concurrent threads you want to run
It is OK to completely ignore the MongoDB line here, just specify localhost even if you haven’t set up and installed it.
The software will still run and save results to disk.
'use strict';
const config = {
db: {
url: 'mongodb://localhost:27017',
name: 'whois'
},
proxies: {
path: 'proxies.json'
},
numThreads: 50, // number of threads per search
outputDir: './results',
outputUrl: '/results/'
};