CircleID

ICANN's evaluators should look at data published on this site. This sort of data helps dramatically reduce time and expense for the evaluation of new gTLD applications while increasing quality. The principle is simple: find the similarities between the 1930 applications.

It is a proof-of-concept project by Arnoldo Mueller-Molina, a young Costa Rican researcher with a doctorate in computational analytics. The analysis is work in progress, but what it shows is striking: identical answers are ubiquitous, even for the most TLD-specific questions.

For many of the key questions, the number of unique answers is below 600 (compared to 1930 applications). Some of the nominal number of unique answers are higher, but mind you, this is just the first iteration. As the algorithm gets refined and adapted, more patterns are found.

Similarity comparisons make sense between questions 15 and 50. For question 14a-14e, similarity comparisons make sense in some cases. ICANN does not publish the technical plan (Q30b-44) and the financial plan (Q45-50b). The site therefore compares the responses 14a-30a (a total of 26 response fields).

If ICANN ran the similarity engine on questions 30b-50b (another 26 response fields, 15 for the technical plan and 11 for the financial plan), it is certain to find an over overwhelming degree of similarity. It would be appropriate for ICANN to publish anonymized statistics as to how many response fields contain exactly the same content after allowing of variations of TLD string and applicant name.

This is all thanks to the Costa Rica ICANN meeting in March this year. Arnoldo was there with a "Newcomer" badge, having come home with PH.D., after spending several years in Japan and Germany. I regard it as proof that the ICANN community is a magnet for talent beyond politics and domain investors.

Arnoldo talked to a number of ICANN delegates and learned about the new gTLD program. He specializes in computational analytics, not domain names. His area of specialization is the art of detecting patterns of similarity. That is a good fit for the new gTLD program. With 1930 applications, it is too time-consuming to find similarities by hand. Arnoldo parsed all the 1930 applications and compared them side by side, using the Okapi BM25 algorithm for a start.

For each question or sub-question, Arnoldo' engine identifies groups (or Clusters) of similar answers. For each group, the algorithm identifies the "model of the group" — it would be defined as the one in the group that appears to be "more similar than others" within the group. That sounds like the Orwellian "more equal than others" but does actually make sense. Arnoldo's site offers side-by-side comparison of each element in a group to the model of the group.

Arnoldo is using his own time and resources to provide this service to the community. A lot more could be done with funding. ICANN could save millions of dollars for itself and others by spending a modest amount for services from experts like Arnoldo. Get some cultural help too: Arnoldo speaks Spanish, English and Japanese, he is perfectly at ease with CJK domains.

(Disclaimer: I have no relationship with Arnoldo or simMachines, his start-up company. I am just impressed by his work and I know for a fact that it is sorely needed. My only involvement is having responded to Arnoldo's questions, as did others who met him in San José.)

By Werner Staub

Related topics: ICANN, Top-Level Domains