Re: An Interview with the Lead Developer of SPF - Part IITal Golan – Jun 30, 2004 10:02 AM PDT
Thank you for sharing an outstanding interview with Meng Wong. I encourage anyone who missed Part I to make sure to give that a read as well.
Though the metaphor is a bit scary, I agree that "There's a war on - a war against spammers." The merits of SPF aside, Meng's "SPF Movement" is pushing people to not only realize, but acknowledge that the problem of spam is not a content issue, but an identity management issue.
While the jury is still out on the impact that SPF alone will have on the problem of spam, we are confident that with the addition of the SPF component, Sender Address Verification (SAV) is without question the most effective solution to stopping spam available today.
Re: An Interview with the Lead Developer of SPF - Part IIPhillip Morelock – Jun 30, 2004 10:58 AM PDT
The success of SPF is in everyone's best interest. We at Evite have supported SPF and cleaned up our headers over the past year so that we can be good citizens.
The cost of compliance and diligence is minor compared with the absolute disaster that awaits all of us in a "1980's SMTP only" world. We at Evite are very excited to be participating in this next generation of email delivery and authentication standards.
Re: An Interview with the Lead Developer of SPF - Part IIjohnjones – Jul 01, 2004 4:20 AM PDT
so I'm thinking about OpenPGP
explain this to me
if you are going to HAVE to use ESMTP why not add the ability to look up public key for domain ?
if you are doing the domain why not query for user ?
finger server or in DNS record ?
is this in the spec ?
in the future then everyone can use weak crypto for emails and not send everything plain text
(speak to the person in internet cafe or bussiness and they dont understand that their msg is transmited plaintext and maybe through other peoples servers who may or may not read the email )
it would be nice to say you thought of people providing public keys but people dont have to use them…
Re: An Interview with the Lead Developer of SPF - Part IIchris – Jul 02, 2004 6:37 AM PDT
FALSE POSITIVES
When did this interview take place? I've posted numerous comments about my SPF false-positive problems to the mailling list, and Meng implimented some new changes to his POBOX service specifically for his customers (including me) who are experiencing this problem!
In a nutshell - any SPF site that doesn't use "-all" will cause customer emails to be silently erased without warning the sender when the recipient is using Baysian filters (eg: Netscape/Thunderbird etc) and the recipient mail server doesn't get a SPF "match".
Re: An Interview with the Lead Developer of SPF - Part IIPeter Bachman – Aug 19, 2004 12:17 PM PDT
I have a small lab where I do development for the c=US national directory and identity management project.
Of course, having my SMTP email address out there for years has caused no lack of joe jobbery taking place, so I was pretty excited to implement SPF on my inbound mail server and get a feel for it. With a bit of tweaking it works well. Now at last (along with other polymorphic spam limiting strategies) my filters get a needed rest.
Many thanks to Meng and others for their work on this.
The value of SMTP e-mail has declined due to the fact that it was designed to work without effective sender authentication, a situation that was fairly balanced when corporate and military non-internet e-mail systems had very stringent sender authentication possible with LDAP and X.500 directories holding public keys. Simply put there has been no requirement up til now for regular end users on the Net to have similar levels of identity management that have been available for years.
Forgery of email header identity which was simply a rare inside joke in the early '90s, (and rarely abused except for some comic relief), has morphed into a potent destructive force that requires continued work like Meng's to retain value within one of the most popular protocols.
At this point we need to understand his controlled burn metaphor, and see at what temperature the seeds for a new forest (perhaps an inverted mathematical network naming tree structure?) fall on fertile soil.
Fundamentally this does all come round to identity management. If you think about it, you don't care where the mail came from, you care that it comes from whom you think sent it. Just a touch of indirection needed. Not where from, but who from. And if that's a virtual who, than an authenticated virtual who. But "where from" is easier right now.
What constitutes that identity is that the person or entity that sent it is not only who they say they are, but also "acting in role as" or bound by contract to do what they say they can do.
Phishers are exploiting what was intentionally engineered into internet protocols to make them easy and cheap to adopt. Think internet bubble.
They are "bottom fishers" of the Weltanschauung.
Whether we attempt to graft these protective additions like SPF onto an already insecure (but highly popular) system such as SMTP or work from the other direction of being members of some group, like a corporation, commercial walled gardens like AOL or MSN, or a collective identity of a nation state which is the name space where I work, there will be some sort of e-mail convergence as Meng alludes to.
If the result is to balkanize people to use only these walled gardens, defended by Sysadmins, then an essential personal character of edge based communications of the internetwork will have been lost.
The fortress mentality of security is very '90s.
What is current is a very po-mo deconstruction of the net to take it back to the personal as well as role based communication where actual relevant connection takes place rather than non-information communication between zombied servers (hosted by clueless end users and going to the same) with broadband connections that is currently occupying a substantial portion of network bandwidth. I don't have a driveway just so people can dump trash in my front yard.
We are gradually being herded and re-centralized to ISP servers with mail surveillance plug ins, or the relative safety of the corporate domain name and servers. How difficult is it to bring up SMTP? So simple a virus/worm can do it! We don't need it to be that simple, hence the net is being deconstructed.
If AOL accepts my mail, because I do publish an SPF record, and helps reject mail that does not come from my server to others, that's a net gain. That's considerably more fine grained that simply determining that my server has a fixed or dynamic ip address and accepting/rejecting it
Re: An Interview with the Lead Developer of SPF - Part IICorwin – Aug 22, 2004 10:41 AM PDT
> Whether we attempt to graft these
> protective additions like SPF onto
> an already insecure (but highly
> popular) system such as SMTP or work
> from the other direction of being
> members of some group, like a corporation,
> commercial walled gardens like AOL or
> MSN, or a collective identity of a
> nation state which is the name
> space where I work, there will be
> some sort of e-mail convergence as
> Meng alludes to.
>
> If the result is to balkanize people
> to use only these walled gardens,
> defended by Sysadmins, then an essential
> personal character of edge based
> communications of the internetwork
> will have been lost.
This "cathedral" mentality of security is so 60's. Ok, I suppose that this is the cost of understanding X.500 ;-)
As a former X.500/PKI seller I grew up to the knowledge that SSL should only be used either with the OpenPGP o Kerberos cyphersuites.
Re: An Interview with the Lead Developer of SPF - Part IIPeter Bachman – Aug 22, 2004 9:59 PM PDT
Conceptually I can see why it might seem that are no applicable examples of globally secure/centralized systems. There are many, and they exhibit differing degrees of centrality, and often redundancy. Sometimes they are "virtually" central, but in fact distributed.
Talking about security in absolutes is not very useful, it's a process which can be applied in different degrees depending on the requirements.
For most people's SMTP Internet email; they have not at this point in time required/demanded a high degree of security, but this may be changing since the threats have become more virulent. As Gilmore alludes to, what is the greater problem, the spam, or the solution to the spam?
I don't think my point that people in general are being herded towards centralized e-mail providers sharing databases, rather than standing up their own servers, as a result of spam is unrealistic. There is discrimination and blacklisting of people's domains that is patently wrong
Yet spammers are standing up servers on unsuspecting hosts with great frequency.
Just because I can implement what ever is the latest in spam filtering or blocking on my machines, including SPF, doesn't mean that most people won't want someone else to do it for them, (and implement many of the suggestions that Meng has outlined).
The same thing may be true with identity, they may realize that whoever is acting as a gatekeeper is not necessarily doing the best job in protecting them from being abused.
People are realizing that "hey I'm only one person, why should I spread my personal contact information all around in each different database, If I can establish one authoritative point of reference, which can be easily changed if need be."
Case in point is fairly recent activity to legally require accuracy in the WHOIS centroids.
The question is then how to scale out solutions in an ethical/effective manner. There may be good solutions that simply don't scale, or don't take hold.
One might define a global system as one that has global usage; rather than defining it as the sum total of all users. Some of these systems are not hooked up to the Internet for obvious reasons.
It's just that up til now, the need has been more clearly demonstrated and defined for security domains that have been focused on specific corporations, and other institutions, who can and do create security policies that are in turn applied, sometimes in a global manner for their users, but not in terms of the set of all Internet users, who rely on a subset of all protocols, known as Internet protocols. However, some of these protocols can and do rely on higher forms of abstraction, which your message alludes to in ASN.1.
Frequently application programmers don't adequately understand the protocols leading to glaring security holes, or simply re-inventing the same security problem in a different form.
In terms of end users with high speed broadband connections, there a significant amount of end nodes that are not secure, which argues that simply being an end node does not offer security in and of itself.
There's no where to run, no where to hide, and an unprotected/unpatched computer hooked up to the net has a life expectancy of less than 20 minutes before it's turned into a spam zombie or otherwise.
I don't think the average Internet end user is going to learn C, do regression testing and fix buffer overflows, write their own code, or patch a kernel.
No they are going to go to a highly centralized and controlled source, and download a patch that works until the next public exploit surfaces.
Does the non-Cathedral approach (i.e. the bazaar) work for security for some; sure it does! However, unless one is in a specific security domain, like a company, (and even then it's difficult) it's difficult to enforce basic security, but then again that's what Sysadmins do.
Whether these protocols are adequate is the case in point. Frequently, end users may require more security, and then they can layer on whatever suits them. But specifically, there is a lack of verifiable identity in SMTP.
How one chooses to layer in identity, it's still the same problem, since security problems are global in nature. One attempt to abstract those problems is found in the Common Critera.
Thank you for sharing an outstanding interview with Meng Wong. I encourage anyone who missed Part I to make sure to give that a read as well.
Though the metaphor is a bit scary, I agree that "There's a war on - a war against spammers." The merits of SPF aside, Meng's "SPF Movement" is pushing people to not only realize, but acknowledge that the problem of spam is not a content issue, but an identity management issue.
While the jury is still out on the impact that SPF alone will have on the problem of spam, we are confident that with the addition of the SPF component, Sender Address Verification (SAV) is without question the most effective solution to stopping spam available today.
The success of SPF is in everyone's best interest. We at Evite have supported SPF and cleaned up our headers over the past year so that we can be good citizens.
The cost of compliance and diligence is minor compared with the absolute disaster that awaits all of us in a "1980's SMTP only" world. We at Evite are very excited to be participating in this next generation of email delivery and authentication standards.
Keep up the good work!
so I'm thinking about OpenPGP
explain this to me
if you are going to HAVE to use ESMTP why not add the ability to look up public key for domain ?
if you are doing the domain why not query for user ?
finger server or in DNS record ?
is this in the spec ?
in the future then everyone can use weak crypto for emails and not send everything plain text
(speak to the person in internet cafe or bussiness and they dont understand that their msg is transmited plaintext and maybe through other peoples servers who may or may not read the email )
it would be nice to say you thought of people providing public keys but people dont have to use them…
regards
John Jones
FALSE POSITIVES
When did this interview take place? I've posted numerous comments about my SPF false-positive problems to the mailling list, and Meng implimented some new changes to his POBOX service specifically for his customers (including me) who are experiencing this problem!
In a nutshell - any SPF site that doesn't use "-all" will cause customer emails to be silently erased without warning the sender when the recipient is using Baysian filters (eg: Netscape/Thunderbird etc) and the recipient mail server doesn't get a SPF "match".
I have a small lab where I do development for the c=US national directory and identity management project.
Of course, having my SMTP email address out there for years has caused no lack of joe jobbery taking place, so I was pretty excited to implement SPF on my inbound mail server and get a feel for it. With a bit of tweaking it works well. Now at last (along with other polymorphic spam limiting strategies) my filters get a needed rest.
Many thanks to Meng and others for their work on this.
The value of SMTP e-mail has declined due to the fact that it was designed to work without effective sender authentication, a situation that was fairly balanced when corporate and military non-internet e-mail systems had very stringent sender authentication possible with LDAP and X.500 directories holding public keys. Simply put there has been no requirement up til now for regular end users on the Net to have similar levels of identity management that have been available for years.
Forgery of email header identity which was simply a rare inside joke in the early '90s, (and rarely abused except for some comic relief), has morphed into a potent destructive force that requires continued work like Meng's to retain value within one of the most popular protocols.
At this point we need to understand his controlled burn metaphor, and see at what temperature the seeds for a new forest (perhaps an inverted mathematical network naming tree structure?) fall on fertile soil.
Fundamentally this does all come round to identity management. If you think about it, you don't care where the mail came from, you care that it comes from whom you think sent it. Just a touch of indirection needed. Not where from, but who from. And if that's a virtual who, than an authenticated virtual who. But "where from" is easier right now.
What constitutes that identity is that the person or entity that sent it is not only who they say they are, but also "acting in role as" or bound by contract to do what they say they can do.
Phishers are exploiting what was intentionally engineered into internet protocols to make them easy and cheap to adopt. Think internet bubble.
They are "bottom fishers" of the Weltanschauung.
Whether we attempt to graft these protective additions like SPF onto an already insecure (but highly popular) system such as SMTP or work from the other direction of being members of some group, like a corporation, commercial walled gardens like AOL or MSN, or a collective identity of a nation state which is the name space where I work, there will be some sort of e-mail convergence as Meng alludes to.
If the result is to balkanize people to use only these walled gardens, defended by Sysadmins, then an essential personal character of edge based communications of the internetwork will have been lost.
The fortress mentality of security is very '90s.
What is current is a very po-mo deconstruction of the net to take it back to the personal as well as role based communication where actual relevant connection takes place rather than non-information communication between zombied servers (hosted by clueless end users and going to the same) with broadband connections that is currently occupying a substantial portion of network bandwidth. I don't have a driveway just so people can dump trash in my front yard.
We are gradually being herded and re-centralized to ISP servers with mail surveillance plug ins, or the relative safety of the corporate domain name and servers. How difficult is it to bring up SMTP? So simple a virus/worm can do it! We don't need it to be that simple, hence the net is being deconstructed.
If AOL accepts my mail, because I do publish an SPF record, and helps reject mail that does not come from my server to others, that's a net gain. That's considerably more fine grained that simply determining that my server has a fixed or dynamic ip address and accepting/rejecting it
> Whether we attempt to graft these
> protective additions like SPF onto
> an already insecure (but highly
> popular) system such as SMTP or work
> from the other direction of being
> members of some group, like a corporation,
> commercial walled gardens like AOL or
> MSN, or a collective identity of a
> nation state which is the name
> space where I work, there will be
> some sort of e-mail convergence as
> Meng alludes to.
>
> If the result is to balkanize people
> to use only these walled gardens,
> defended by Sysadmins, then an essential
> personal character of edge based
> communications of the internetwork
> will have been lost.
This "cathedral" mentality of security is so 60's. Ok, I suppose that this is the cost of understanding X.500 ;-)
As a former X.500/PKI seller I grew up to the knowledge that SSL should only be used either with the OpenPGP o Kerberos cyphersuites.
Global AND centralized security is a real myth.
Regards.
Conceptually I can see why it might seem that are no applicable examples of globally secure/centralized systems. There are many, and they exhibit differing degrees of centrality, and often redundancy. Sometimes they are "virtually" central, but in fact distributed.
Talking about security in absolutes is not very useful, it's a process which can be applied in different degrees depending on the requirements.
For most people's SMTP Internet email; they have not at this point in time required/demanded a high degree of security, but this may be changing since the threats have become more virulent. As Gilmore alludes to, what is the greater problem, the spam, or the solution to the spam?
I don't think my point that people in general are being herded towards centralized e-mail providers sharing databases, rather than standing up their own servers, as a result of spam is unrealistic. There is discrimination and blacklisting of people's domains that is patently wrong
Yet spammers are standing up servers on unsuspecting hosts with great frequency.
Just because I can implement what ever is the latest in spam filtering or blocking on my machines, including SPF, doesn't mean that most people won't want someone else to do it for them, (and implement many of the suggestions that Meng has outlined).
The same thing may be true with identity, they may realize that whoever is acting as a gatekeeper is not necessarily doing the best job in protecting them from being abused.
People are realizing that "hey I'm only one person, why should I spread my personal contact information all around in each different database, If I can establish one authoritative point of reference, which can be easily changed if need be."
Case in point is fairly recent activity to legally require accuracy in the WHOIS centroids.
The question is then how to scale out solutions in an ethical/effective manner. There may be good solutions that simply don't scale, or don't take hold.
One might define a global system as one that has global usage; rather than defining it as the sum total of all users. Some of these systems are not hooked up to the Internet for obvious reasons.
It's just that up til now, the need has been more clearly demonstrated and defined for security domains that have been focused on specific corporations, and other institutions, who can and do create security policies that are in turn applied, sometimes in a global manner for their users, but not in terms of the set of all Internet users, who rely on a subset of all protocols, known as Internet protocols. However, some of these protocols can and do rely on higher forms of abstraction, which your message alludes to in ASN.1.
Frequently application programmers don't adequately understand the protocols leading to glaring security holes, or simply re-inventing the same security problem in a different form.
In terms of end users with high speed broadband connections, there a significant amount of end nodes that are not secure, which argues that simply being an end node does not offer security in and of itself.
There's no where to run, no where to hide, and an unprotected/unpatched computer hooked up to the net has a life expectancy of less than 20 minutes before it's turned into a spam zombie or otherwise.
I don't think the average Internet end user is going to learn C, do regression testing and fix buffer overflows, write their own code, or patch a kernel.
No they are going to go to a highly centralized and controlled source, and download a patch that works until the next public exploit surfaces.
Does the non-Cathedral approach (i.e. the bazaar) work for security for some; sure it does! However, unless one is in a specific security domain, like a company, (and even then it's difficult) it's difficult to enforce basic security, but then again that's what Sysadmins do.
Whether these protocols are adequate is the case in point. Frequently, end users may require more security, and then they can layer on whatever suits them. But specifically, there is a lack of verifiable identity in SMTP.
How one chooses to layer in identity, it's still the same problem, since security problems are global in nature. One attempt to abstract those problems is found in the Common Critera.
http://www.commoncriteriaportal.org/
This ill-designed web form ate my reply.
I'm sorry I won't write again my 4567 characters reply.
What kind of web-incompetents designed this site?
You can contact me at if you find this conversation interesting, as I do ;-)
Regards.