I try to keep an up-to-date list of all registered .de domains. Since the Denic does not publish the .de zone file, it “has” to be reverse engineered [1]. In this article i am going to cover one approach i recently tested. I wanted to see how many .com domains are also registered as .de domains and vice versa.

Lets see the results:

Out of 15.123.523 registered .de Domains [2], 4.510.542 are also registered as .com domain, around 30% of all .de domains. Thats cool! By scanning the .com zonefile it is possible to reverse engineer one third of all registered .de Domains. Thats a nice start for further exploration.

Approach

Since i did not want to waste too much time and ressources with whois requests i relied on the DNS to check the status of each domain. Surely this is not as accurate as doing real whois querys, but it is ok to get the picture.

I took the .com zone file from 9th July 2012 and parsed a list of all registered slds in the .com zone to use as a foundation. Beeing equipped with a list of slds i was ready to start the hunt for existing .de domains. The “Powerdns Recursor” is a very powerful and fast resolver and a beautiful piece of software. It is used by ISPs around the world and easily handles thousands of parallel dns queries.

I fed the recursor with a custom C-Programm that takes a list of hostnames and tries to resolve them in parallel threads. Combined with Powerdns its pretty fast and gives me enough speed to handle millions of queries in an acceptable timeframe. I use this a lot, for example as a prefilter for availability / whois checks of large lists.

After some filtering out of the errors and edge cases 104.003.552 .com Domains have been checked for their .de counterparts. This is just one of many possible approaches, and i am probably going to cover some other ways to reconstruct the .de zone for fun and profit.

I hope you liked this article! Let me know if you want more of this stuff or have any suggestions!

– 
[1] A longer time ago the actual zonefile was unintenionally available for a short timeframe.
[2] Source: Denic, July 2012
[*] Domain Name Analysis: http://datagenetics.com/blog/march22012/index.html
 

4 Responses to Reverse engineering the .de zonefile for fun and profit

  1. Paul sagt:

    I am currently waiting for a scan of .net to finish.

  2. Danny sagt:

    I’m really shocked about your results – I would have guessed that most people who register a .DE domain, would also want to register the .COM domain as well.

    Do you have any strategy for uncovering the other 10 million domains?

    • Paul sagt:

      Hey Danny,

      yes there are ways to uncover a lot more domains that i can not cover in detail here. Drop me a line if i can help with anything specific.

  3. ViewDNS.info sagt:

    There’s a list of over 9M registered .de domains at http://viewdns.info/data/. Would be interesting to see what the other 4.5M that are in that file are that aren’t in the .com!

Hinterlasse eine Antwort

Deine E-Mail-Adresse wird nicht veröffentlicht. Erforderliche Felder sind markiert *

Du kannst folgende HTML-Tags benutzen: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Email