The seed for Survey 5 started with a list of every hosts that mentioned either of the Internet Archive's two User Agents:
archive.org_bot - 50,296,468
ia_archiver - 41,566,708
For a total of Total of 91,863,176 hosts
Then (Surveyx) a 2nd seed of 257,668,245 domains were added.
That list was all of the domains from a list of 4.5 billion hosts, from the list of 2.5 trillion links, from all the URLs available in the Wayback Machine.
This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds)
The WARC files associated with this crawl are not currently available to the general public.
_final_07.jpg)
_final_09.jpg)
_final_12.jpg)
_final_15.jpg)
