Home / Blogs

Google as a Real-time Blackhole List

Noam Rathaus

For those not familiar with RBL, the term means Real-time Blackhole List, it is mainly used for SPAM fighting. I have recently started playing around with Google as an RBL engine, the idea is that if the search term I use hits too many hits it is likely to be SPAM.

The danger of course is that the term could be simply popular — but the trick here is that I'm using something very special as the search term — the IP address of the poster.

The IP address shouldn't be popular; except for a few rare cases, IP addresses listed on Google are directly related to SPAM — either they are listed under wiki-like sites as being banned, or they appear as mass-comment posters. Simply put, if your IP is listed in Google you must be up to no good.

How good is this method? Nothing is bullet proof, but if you have a suspicion of something being SPAM, put the IP in Google and see there are hits; Almost all the comment SPAM I filtered out this month had more than 100 hits in Google, all non-SPAM had either 0 or below the 10 hits mark.

BTW: A good advantage of Google is that it is quick — a few seconds to get a respond — a disadvantage is that you cannot just "hammer" them with searches or they will block you — maybe someone can pickup this idea and make an RBL from IP addresses using Google as a back-engine.

By Noam Rathaus, Chief Technology Officer. Visit the blog maintained by Noam Rathaus here.

Related topics: IP Addressing, Spam

WEEKLY WRAP — Get CircleID's Weekly Summary Report by Email:

Comments

Re: Google as a Real-time Blackhole List Suresh Ramasubramanian  –  Jan 10, 2008 7:27 PM PDT

Not a very bright idea. Certainly one that I wouldnt automate.

I might possibly look it up to see what it appears to be, reputation-wise, but

1. That's just one metric in a decision
2. It requires human rather than scriptintelligence

Re: Google as a Real-time Blackhole List Richard Golodner  –  Jan 10, 2008 10:43 PM PDT

I must agree with Suresh on this idea. It does require some human intelligence to be ale to make a decision based on what you get from doing a quick Google search.
There are a variety of reasons you might see an IP address posted often, what if it an address of some sight that does not use dns to reach it, or there is no record in place for it as an administrative mistake.
In some cases only an IP adress is used to so that trafic to that site is kept to a minimum.
Perhaps this is not a good example, but I think there are much better and more accurate metrics for determinig if a site is a legitimate spam generator. Just my own thoughts. Not trying to be offensive.

To post comments, please login or create an account.

Related Blogs

A Logical Place to Start the IPv6 Transition

Business Case for IPv6 - Part 2

Cel-e-brate v6, Come On!

Measuring IPv6 at the Network and the Customer Level

If You Build It, They Will Come.

Related News

Topics

Industry Updates – Sponsored Posts

Frontline and Nominum Deliver Integrated DNS-Based Platform to Enhance Enterprise Security

Nominum Launches Comprehensive Suite of DNS-Based Security Solutions for Russian Service Providers

Nominum Sets New Record for Network Speed and Efficiency

Implementing a Cyber-Security Code of Conduct: Real-Life Lessons From Australia (Webinar)

Nominum and Nixu Software to Deliver Centralized DNS and DHCP Management Solution

DNS on Defense, DNS on Offense

Managing Outbound Spam: A New DNS-based Approach For Stopping Abuse (Webinar)

Nixu NameSurfer 7.2 Strikes Rich at Dojo

Is IPv6 the New Y2K? (Primer)

MarkMonitor Fraud Intelligence Report, Q4 2011

Nixu NEE Powers Location-Aware IPAM

Nixu DDI Awarded Gold Medal for Its IPv6 Support

UK Cabinet Office Looks to BlueCat Networks' Expertise and Best Practices for Securing PSN

BlueCat Networks Helps Organizations Transition to IPv6 with HP

BlueCat Networks to Host Webinar on DNS, DHCP and IPAM Featuring Independent Research Firm

IPAM and DHCPv6 Shake Hand in Nixu NameSurfer 7.1 Series

Quova Rebrands as Neustar IP Intelligence

BlueCat Networks Partners with Computacenter to Deliver Cloud-Ready IP Address Management (IPAM)

Giving VIP Treatment to IPAM with Nixu NameSurfer Suite 7.0.2

Alesund Kommune Replaces Windows 2000 Server with BlueCat Networks' DNS/DHCP Solution

Hot Topics

Neustar UltraDNS

DNS

Sponsored by
Neustar UltraDNS
Nominum

IPv6

Sponsored by
Nominum
Verisign

Security

Sponsored by
Verisign
Afilias

DNS Security

Sponsored by
Afilias
dotMobi

Mobile

Sponsored by
dotMobi
Minds + Machines

Top-Level Domains

Sponsored by
Minds + Machines