Today's Internet is wonderful for solving hard problems such as connecting to Amazon to buy goods or for using Netflix. Amazon and Netflix, among others, demonstrate what is possible if you put in enough effort.
Yet if we are to understand the Internet we need to look beyond those applications to the simplest application such as sending one bit of information from a light switch to a light fixture.
If we seek to improve on the Internet or, to speak loosely, get more Internet, we need to recognize that its power lies in making it easy for everyone and anyone to create their solutions by simply exchanging a few bits between two end points.
And what could be simpler than sending one bit from a light switch to a light bulb? If we can't do something that simple then we are stuck refining what we have now and will find it difficult to move beyond more of the same.
The Light Problem
In 1996 I was on a committee representing Microsoft and working with Honeywell and Intel on what was supposed to become Home Plug and Play. I wanted to use standard Internet Protocols but I was stymied by the simplest of problems — I couldn't turn on a light using the Internet protocols!
Of course today people do produce light bulbs and light switches that use IP and I can send a message from the switch to the bulb to turn it on. But how do I set this up and establish the relationship between the switch and the bulb?
We can program a switch to send a message to a bulb. We could then register their identifiers in the DNS just like we do for a website. But does it really make sense to have to query the DNS just to turn on your light? If you lose connectivity and are using a local generator does that mean you can't turn on your lights because you can't get to the DNS?
Of course using the DNS has other problems. You have to pay an annual fee just to keep the name registered and if you miss a payment you lose ownership. In effect your light switch is a service and you are no longer in control of your own home!
Those who understand the Internet realize you don't need to use the DNS. If two devices are on the same wire they can simply use the MAC address to send the message. Today IPv6 makes this simpler because you can use the MAC address to form the link-local IP address. This works as long as the two devices are on the same local area network and you don't need to replace a device (thus changing the MAC address). MAC addresses are assigned from a central source — your DIY device won't have an official MAC address although usually that doesn't matter.
Using Wi-Fi presents an additional problem. We've accepted the misguided idea that security is implemented in the network by putting a security perimeter around the network. In order for this to work we have to carefully manage every step along the path to make sure the right credentials are presented at each step along the way and any failure along the path will prevent the message from getting through. This is the opposite of the resilience that has made the Internet work.
The other reason for locking down access points is the fear that we will use up the Internet — another consequence of treating the Internet as a service we get from a provider as if we could use up the supply of ones and zeros. From bad metaphors come terrible policies.
At least if you're careful enough you can get the light switch to work. Until you leave home with the switch. If you are using the DNS and the light bulb has a publicly valid IP address (that is, it is not hidden behind a NAT) you may be able to send a message to the bulb. Probably anyone can since that's another issue and we don't have standard practices for managing that relationship. Though if you are visiting a friend during some event that allows for local connectivity but not global you might still be unable to reach the DNS servers. Yes, caching helps but that's neither a permanent solution nor reliable.
Once you're away from home you find that most access points are locked down and typically you need an account and/or a browser in order to have access even if there is no charge. Sometimes it is as simple as pressing agree because the lawyers are doing their damndest to remove any risks. Sadly this includes the risk of success. The problem is that the applications are totally unaware of why the bits aren't getting through. There is no way to know and that blockage may be further downstream. All you know is that the Internet pipe (the path) is clogged.
There is some irony in the fact that some of the efforts to make the Internet more available are making it worse. I now find that my apps often hang because unbeknownst to me I've connected to an Xfinity access point and something has gone wrong. Even a well-meaning totally open access point might fail or a local provider may have a policy rule in the path. While there is some route-around in the backbone the edge has brittle single-path (or should we say single-pipe) connectivity.
There are work-arounds for some of this such as indirect references through a third party (AKA "the cloud")
But it Works!
There's some cognitive dissonance because despite all of these complaints the Internet works very well. You can reach websites around the world and casually have high quality video conversations.
And you can get the IP light switch to work though it may take some effort to work around the problems. And therein lies the problem. For high value applications you can get things to work. For that matter you were able to make a phone call across the country and send messages around the world a century ago long before the Internet.
Trying to understand the Internet by looking at what we do with it limits us to doing more of the same. The Internet has been transformational because it created the opportunity to do what could not be anticipated. In fact the Internet itself wasn't so much anticipated as happened.
Very simply we can look at radio packet networks as a catalyst because they were unreliable but that wasn't a problem for programmers. If a packet was lost then the program could simply resend it. What is less obvious is that not all packets need to get through. If you want the current temperature you just send the new current temperature and ignore the readings that failed to get through.
There was no third party in the path trying to add value by making promises of delivery and allowing only valuable packets through.
The Internet thrived because of this benign neglect. Initially it was useful for applications that weren't very important such as (slowly) exchanging files and email. If you wanted a service such as a voice conversation then you used a different packet network — the phone system designed to guarantee specific services would work.
The Internet couldn't make such guarantees because only the applications outside the network knew what the packets meant. In the middle there were just raw packets totally devoid of any meaning or even relationships between the packets.
In the early 1990's the world discovered the World Wide Web. It was one of the many experiments enabled by the availability of the simple unfettered connectivity provided by the Internet. With no third party in the middle Tim Berners-Lee was able to experiment and set an example that others could build on.
The big surprise is that the increased demean for "web" created a bigger supply of "Internet". In technical terms the more demand for the capacity to exchange packets the more capacity was made available. This is the way real markets work — if the customers are buying the products then you supply more of it. This is especially true for the Internet because it's merely a technique for using any available means to exchange packets.
We can casually have conversions of the Internet with no charge for a service like "video" only because no one can promise that it will work. The phone network, on the other hand, promises that voice will work. It did try to promise video would work in the 1960's but in order to keep the promise it had to offer expensive black and white limited video in order to fit within its technical and business constraints. In the end it was a novelty rather than something we could use casually.
Today voice on the Internet not only works but has made the entire existing phone service (the PSTN) obsolete and the FCC is planning to decommission it! Too bad the FCC's approach is to kill the Internet with the kindness that has doomed the PSTN.
To make matters worse the current Internet is a work in progress. As we've seen the DNS provides us with a mechanism for finding other end points but not the stable relationships we need. We need to develop appropriate technologies rather than treat such shims as essential elements of Internet architecture and governance.
More Internet by Doing Less
The problem we face in trying to "get more Internet" (get more of the benefits we associate with the Internet) is that the Internet isn't a thing and, more problematic, is that the traditional solution-finding process of public policy and the engineering principles such as layers work against us in this case.
In a sense the Internet is similar to other transitions. Railroads were transformative because they enabled commerce over a distance but, over time, became captive to the accidental properties of the rails and rolling stock and the attendant business models. We are able to "conquer distance" using facilities such as roads and sidewalks. Such facilities differ from railroads in that value accrues to society as a whole rather than having an owner which is required to limit access in order to make a profit.
Today we would say that railroads were TaaS or Transportation as a Service as opposed to DIY transport in which we walk or use whatever means are available. TaaS would be a rent-seeking model that can only provide transport to destinations that would generate revenue to the provider.
Traditional telecommunications is CaaS (Communications as a Service) and its history mirrors that of the railroads to the point that the FCC is modeled on the agency that regulated railroads. The implicit assumption is that we must have a railroad-like system because in the days of the telegraph, analog telephony was very much like a railroad with a service provider assuring reliable delivery.
And the Internet, going back to the days of the radio packet networks, has shown us how to do our own communicating using any means available. We understand how to take advantage of opportunities and don't require ordered or reliable delivery. What we do need is an economic model that doesn't require a direct relationship between the user (or application) and the parties along the path who may be assisting in the transport of packets. This is more like a sidewalk assisting walking than a railroads notion of assistance as a service.
It's not just about money — relying on a third party for one's name as in the case of the DNS is also a problem. But the economic model is the gating factor because it's hard to workaround a rent-seeker who owns the path and who must make a profit if we are to communicate at all.
We think of telecommunications in terms of the services provided — telephony and television being primary. But now that all content is converted to bits and we can use services from others (VoIP, Hulu, Apple TV, HBO etc.) as well as services we create ourselves.
In this formulation everything is reduced to charging us to exchange bits. No wonder it's so important for the carriers to make sure that all the access points are locked down. If the carriers are to charge you for exchanging bits they must first prevent unbilled bits from passing.
The idea that a carrier must prevent bits from flowing isn't obvious because we've been taught it is difficult and expensive to exchange bits. And that was true in days of analog signaling. But think about your home connectivity — you pay nothing per month (within the home) and a gigabit switch is a very inexpensive purchase. That's because we allow Moore's law to work where we have ownership. It doesn't work when we have a rent-seeker setting the rules.
Yet we accept this because we treat the web as if it were provided by the carrier rather than something we do with available connectivity. As long as high value services such as accessing web sites, video, commerce etc. seem to work then everything seems fine. If anything we want more of the same which translates into asking for faster and faster Internet.
We also want solutions so we ask for smart cities instead of empowering the smart people who live there. It may be nice to have a car that drives itself but it would be nicer to have a city that provides information no matter how the car might be driven.
Just as with our home there is no thing with boundaries that is "The Internet" or "the smarts". Smart is what we do with the opportunities and information available. By thinking the Internet is something separate and apart we accept the idea of a wall around the Internet which we must pay to cross. We let ourselves be clients rather than recognize our empowerment.
Before we can address the protocol and policy issues we need to understand and appreciate the value of unfettered connectivity.
I started this essay with the example of a light switch. It's a very simple problem but a defining one because when we get down to the essentials it's about sending a single message to from point A to point B. All the rest is built on that simple capability.
When we look at the state of home control we find out that it is possible to pay someone to put in a custom system for a house. Advanced users can do what I did and buy "smart" switches and devices and get them to work within the constraints I describe above.
But the norm for home control is still the common light switch. It is indeed a simple form of home control even if it is limited to directly controlling a single light by connecting or disconnecting it from a power source.
Everything changes once we think of this as a control system with the light switch, in effect, sending a message to the bulb to turn on (or off).
The relationships are no longer defined by the wiring and can be changed in software. We can also define rules by incorporating sensors and do something sophisticated like "first open the shades and then, if necessary, tell the bulb to provide light".
We're not just replacing the wire but shifting from a world of physical objects to a world of abstractions. Key to taking advantage of this is our ability to focus on relationships. Rather than treating communication as a service it becomes something we do with the available facilities.
To put it in pragmatic terms I can simply send a message from the switch to the bulb without having to worry about a provider expecting payment to let the bits pass.
This works to the extent we can treat the wires and radios as a common facility just like halls and sidewalks. We then extend the range of "just works" by joining with our neighbors pay for the wires like we pay for the sidewalks.
This approach mirrors the history of the Internet. First individual research groups would pay for the wires (and radios). As the network range increased it would be funded by the university or by a corporation. These systems were interconnected using leased lines as tunnels between the schools.
This is what happens with your home network now. You interconnect with others by buying a path through telecommunications. We call this "broadband" because it's typically a tunnel through the broadband facilities. But don't let that confuse you. You're not consuming or using up "Internet".
The term "provider" and the business model of telecom will soon become relics from the past but no matter. The new story is powerful and will start to dominate.
To avoid confusion I'm using the fresh term Ambient Connectivity to emphasize the simple connectivity.
Just as corporations, universities and research groups fund common connectivity, the management board of an apartment house can fund connectivity for a building. Eventually this perimeter would grow to cities and beyond. To connect beyond that the community as a whole would pay for a shared connection and get the benefit of dramatically lower cost thanks to the combined purchasing power.
Within these connected areas we will be able to explore the possibilities of the simple connectivity epitomized by the switch/bulb relationship. If we can do connected switches then we can do explore healthcare and other applications.
It is this is ability to do simple things simply that is at the heart of the innovation and value-creation we associate with the Internet.
It isn't enough to refine today's applications. We must instead provide the building blocks of the future and we are only at the very beginning of the process.
And then we can began to address the challenges of making a light switch (and so much more) "just work".
* * *
My Related Writings
There is a lot that is new in this essay but much that I go into more detail in other essays. First there are my columns in the IEEE CE Magazine. For convenience I have preprint versions available on my website:
Refactoring Consumer Electronics goes into considerable technical detail about the history of the Internet and whys of what it is.
(Not) In Control address some of the home control issues and the importance of having a common protocol for exchange messages.
The Internet of Things vs. Access goes into more detail about the problem of implementing the so-called Internet of Things given that we've accepted this strange notion that the there is an Internet out there somewhere that we have to access.
There are some essays here on CircleID including:
Purpose versus Discovery is raises similar issues in explaining that the value of the Internet comes from its lack of purpose.
Internet Connectivity: Toward a Sustainable Funding Model goes into more detail about what I call the sidewalk funding model.
Other essays include:
Understanding Ambient Connectivity which explains ore about the new framing of Ambient Connectivity.
Not Super is a relatively short essay explaining why the so-called broadband business model doesn't make any sense.
Beyond Limits is a chapter I wrote in 1996 why Moore's Law is about markets. While this article focuses on the Internet the economic concepts are far deeper and more widely applicable. Writing that chapter helped me catalyze my thinking.
|Cybersquatting||Policy & Regulation|
|DNS Security||Registry Services|
|IP Addressing||White Space|
Neustar DDoS Protection
Minds + Machines
Neustar DNS Services