SecuritySpace Survey Data Mining SQL Database Schema

Browse:

select * from

where

IP Addresses of Web Sites

1.1 Description

During the resolution of IP addresses of hostnames of known web sites, IP address information is returned. While the primary IP (the first of possibly multiple addresses returned) is recorded in the web sites tables, here we record all IP addresses that were returned. While most information will be duplicate, there will be a certain number of sites that return multiple addresses.

In the March 2008 dataset, there were a total of 33.6 million web sites for which hostname resolution was done, and a total of 39.8 million IP addresses recorded.

This information is available starting with the November 2000 dataset, and forms the basis of our DNS Load Balancing report.

1.2 Schema

Name	Type	Description
hostname	varchar(80)	The hostname of the web site as originally found by our web spiders.
domain	varchar(80)	The domain name of the site, derived from the hostname. This may be the same as the hostname.
ipaddr	varchar(15)	The IP addresses to which the hostname resolved. If a given hostname resolves to multiple IP addresses, each will address will be recorded in a separate record.

1.3 Keys

hostname
domain
ipaddr

1.4 Data Collection Methodology

Data is collected as part of Phase 1 of our web site data collection. This is the DNS query phase of collection, and is responsible for resolving all known hostnames in our database to one or more IP addresses.