I just posted a summary of the current data portability landscape to the Official DataPortability Blog.

From the post:

Closed platforms are like ice cubes in a glass of water. They will float for a while. They will change the temperature of the liquid
beneath. Ultimately, however, the ice cube must eventually melt into the wider web.

Facebook’s success with Facebook Connect can and will further drive innovation in the community to develop an open alternative.

Facebook’s success will (like Google, Microsoft and Yahoo, AOL, Myspace, countless major media properties and countless small startups) to create alternatives. At least some of those participants will recognize (if they have not already) that the most open among them will earn both the respect and the market share of the next phase. Moving from Facebook Connect’s ‘data portability’ to Interoperable DataPortability.

A web of Data.

That’s a landscape where we can continue to innovate on a level playing field.

The web-wide social network

November 19, 2008

Ross Dawson has an excellent summary of a Gartner presentation on the Distributed Social Web by David Cearley. A web where each participant is their own central node on a web-wide social network.

It is the only natural conclusion of the vision of Data Portability.

It will be made possible by a series of futurists, technologists, philanthropists and engineers developing core building blocks like OpenID, oAuth, APML, PortableContacts, XMPP, RSS/ATOM, OPML, Microformats and more.

It will be commercialized by a series of entrepreneurial start ups with stars in their eyes running in and around the feet of the giants who are each fighting each other to keep up. Startups like JS-Kit.

It will be fueled by traditional and not so traditional media companies, steered by young, idealistic intrapraneurs, who are willing to take a bet in order to stake their claim on the next generation of social networking and human communication.

It will be monetized by a recognition that one can’t monetize word-of-mouth. Instead Attention will emerge as the ultimate way to measure, discover and interact with participants. See Faraday Media.

It will be popularized by bloggers, smart IT journalists and conference organizers who understand the importance of open over closed.

We have already started to see a preview of the world to come via the early attempts at rudimentary aggregators and proprietary data portability implementations. This is just the beginning of the beginning.

For a more details around the emerging trends, check out Ross’ post.

Speaking at Social Media

September 24, 2008

 

Speaking at Social Media

Speaking at Social Media

Join me there! Using the code “zaph” will get you half price off ($495).

When talking to people about Data Portability there is a couple of questions that always gets asked first.

 

Why would a vendor allow users to leave their service?

 

Why make it easy for users to take the preacious data you have about them and use it on other sites?

or…

What is the business justification for letting data walk out the door?

 

You spent a lot of time and energy to get users to sign up and give up their data right?

My answer always consists of a number of parts. There are a number of reasons why vendors should get involved in an open ecosystem of data interchange. User respect, reduced barrier to entry, reduced network fatigue and more.

Today, however, I’d like to focus on one particular reason why the value of Data Lockin is a myth.

Here is a diagram that represents the data you have about your user. 100%. Awesome right? You have a complete view of the proprietary data you have managed to collect about your user.

100% of your proprietary data

Have you ever considered, however, that your user’s data actually looks like this?

Your User's Data

Your User's Complete Data Set

Even if you are Google, and you know every search your users do, every document they write, every chat they have – you still don’t know their facebook social graph. You don’t know their tweet stream. You don’t know the books they bought on Amazon.

Your view of your user’s data pales in comparisson to their complete data set.

Not to mention the data you think you have is out-of-date weeks after you aquire it. Interests change, friends come and go, projects, assignments and jobs change and much, much more.

Rapid Expiration of Data

Rapid Expiration of Data

So, Data Portability is not about letting your users ‘walk out’ of your service. Data Portability is about enabling, empowering and encouraging your users to bring all their data with them, to connect your data to the rest of their data ecosystem and to continue to refresh and maintain the data on an ongoing basis.

The value of Data Lockin is a myth. Data Portability is an opportunity to have true visibility into a user’s friends, interests, content and comments.

Are you thinking about joining the data web?

Anthill is the leading entrepreneurial magazine in Australia. They have released a list of the top 30 entrepreneurs under 30. Somehow, someone hacked the list and added my name!

From the magazine:

They collectively turnover hundreds of millions of dollars each year, yet some are barely out of university. They are proud to be Australian but see their home-grown success as little more than a stepping stone. They have never known serious recession, political instability or significant global conflict, yet they are better educated and better informed than new business owners of any generation preceding them. Meet the future of business in Australia.

Chris Saad
Age: 26
Location: Queensland
Company/Role: Faraday Media

At 26, Chris Saad is one of Australia’s most impressive young web entrepreneurs. His theory and practice around web standards – specifically “DataPortability” and “Attention Management” – have gained significant traction and are set to have a profound impact on the evolution of media in the digital age. Saad has co-founded several web-related companies and organisations, most prominently Faraday Media in 2006, of which he is CEO. Faraday Media is developing Particls, a technology that learns user habit and taste and delivers relevant information to them via news crawler, SMS, email, flash visualisations, etc. He also co-founded the Media 2.0 Workgroup with 14 industry “commentators, agitators and innovators”. There’s no shortage of ideas or energy in this digitally-minded entrepreneur. One to watch in the years to come.

Make sure you click through to the Article, subscribe to the mag and read the other 29 profiles!

Of course, singling out 30 ‘front men’ does not really do justice to the real people who work tirelessly to make successful business happen. People like my business partner and co-founder who actually builds our Faraday Media products Ashley Angell. Like our investors, our team, our advisors and supporters who make everything possible.

To all of them and to our customers and partners – thank you for making this sort of thing possible.

I also look forward to clicking through to the other profiles and learning more about the other people listed – seems like a great group of Aussies!

How? Using Silverlight.

Here’s the strategy as I see it.

First, the underlying Silverlight technologies (XAML and .NET) are encouraging client-side Windows developers to think beyond boring forms apps and delve into the wonderful world of vector graphics with 3D, sliding reflective surfaces. In short, Microsoft is encouraging developers to use the power of the client-side to ensure that Windows apps to continue to make web-apps look like boring documents.

Second, having raised the bar on client-side user experiences, the Silverlight runtime enables developers to maintain that high bar of multimedia user experience in the browser. But Silverlight is not like flash. Developers can use the exact same development assets, metaphors and tools they know and love. Objects, Controls, Visual Studio and more. Users will come to expect web-based experiences that match their newly enhanced client-side ones.

Third, if Silverlight makes it possible to essentially deploy client-side style applications through the browser, which Microsoft product can now become truly web enabled?

You guessed it. Office.

Silverlight represents a way for Microsoft to not just complete in the online office space, but blow it out of the water with a product that is as good (or better) than its client-side counterpart. There was no way Microsoft was going to bet their web-based application strategy on Flash or try to hack together an Ajax word processor. Silverlight, and its true Object Orientated .NET foundation, are a perfect platform for the web-enablement of their traditionally client-side suite.

Fourth, Silverlight is positioned as the new application platform. It exists in places Microsoft has never existed before. On Nokia phones (the land of Symbian), Linux workstations and OSX. Even iPhone could conceivably run Silverlight since it runs the full fledged Safari browser. And now there is an announcement that Silverlight will be shipped with millions of HP computers.

With Silverlight now coming out on Nokia phones, delivered as part of the Olympics coverage and embedded throughout MS properties and content deals popping up everywhere, Microsoft is gaining enormous distribution potential. If they can somehow skirt the anti-trust issues, they could even bundle it with IE8.

Silverlight is a critical and masterful piece of technology and strategy from the Redmond giant. It allows them to leverage their tools and technologies from the client, raise the bar on web-based experiences, deploy their client-side apps through a browser and broaden their platform reach into every device and screen in a user’s life.

GSP East 2008

I am speaking at Graphing Social Patterns. Will you be there?

You can use this discount code for a 20% discount: gspe08fos

Follow me on Twitter to work out where I am – hopefully we can catch up face-to-face.

Chris Messina has posted a fantastic post on his blog about DataPortability. It is a real pleasure to read his thoughtful and well articulated questions, concerns and compliments about the project.

I am going to try to answer or comment on many of his comments below by quoting big chunks and including my ideas.

Contrary to what some folks have argued, I think that the semantics and meaning of the phrase “data portability” are important. To me data portability denotes the act of moving data from one place to another, and that the data should, therefore, be thought of like a physical thing, with physical properties.

So if you ask me what is “data portability”, I’ll concede that it’s a symbol for starting a conversation about what’s wrong with the state of social networks. Beyond that, I think there’s a great danger that, as a result of framing the current opportunity around “data portability”, the story that will get picked up and retold will be the about copying data between social networks, rather than the more compelling, more future-facing, and frankly more likely situation of data streaming from trusted brokered sources to downstream authorized consumers. But, I guess “copying” and “moving” data is easier to grasp conceptually, and so that’s what I think a lot of people will think when they hear the phrase. In any case, it gets the conversation started, and from there, where it goes, is anyone’s guess.

I do understand the concerns about names and the underlying meaning they convey. I do think, however, that the ship has sailed on the branding of the movement. We can call it Data Availability, Data Connectivity, Data Streaming, Data Accessibility or we can call it what everyone is already calling it – Data Portability. I think the nuance of meaning is probably one that only affects the technologists closest to the issue; not the broader audience we are trying to reach.

Also, we have long defined ‘portability’ as the ability to port the data or port the context in which the data is used. That is, use data from one application from within the context of another application.

Is it a perfect name? Probably not.

Is it worth diluting the conversation to stop and rename it? probably not.

Can the community live with it? I would argue they could. So we should probably move on.

OpenID, along with OAuth, microformats, RSS, OPML, RDF, APML and XMPP are all open and non-proprietary technologies — formats and protocols — that grace the DataPortability homepage. How they ended up on the homepage, or what selection criteria is used to pick them, is beyond me (for example, I would have added ATOM to the list). So the best way that I can describe the relationship between any of these technologies and DataPortability is that, at some point, the powers that be within the group decided to throw a logo on their homepage and add it to their “social software stack”.

I’m curious if, besides Atom, there are any other standards that community members would suggest as an addition to the list. Are there any on there that don’t belong there? Having discussed this topic for a long time now, I think that most people agree that each of those technologies listed have a place in the conversation. The final ‘stack’ however will be determined by the Technical Best Practice documents.

Beyond that, it should be noted that OpenID, OAuth, microformats et al have been in development for the last several years, and have been building up momentum and communities all on their own, without and prior to the existence of the DP initiative.

Agreed – this is a fact I constantly repeat to everyone I speak to – particularly in public forums and on podcasts. I don’t think, however, anyone can deny that the DataPortability project has accelerated the momentum and helped to propel the conversation into the mainstream. It is gratifying that many of the participants in each of these standards groups (particularly the groups that don’t have as much visibility as OpenID, Microformats or oAuth) are now participating in the DataPortability project as a way to promote their work to a broader audience.

In fact, the DP project really only got its start last November with an idea presented by Josh Patterson and Josh Lewis called WRFS, or the “Web Relational File System”. At the time, the WRFS was intended to serve as a “reference design” for describing how data portability should work and this was to serve as the foundation of the DP recommendations.

In January, after ongoing discussions, Josh decided that it would be best to spin WRFS off into its own project and started a separate mailing list, leaving DP to focus exclusively on evangelizing existing technologies and communities and, in the oft-repeated words of Chris Saad, to invent nothing new (a mantra inherited from the OAuth and microformats efforts).

This is actually not quite accurate. The DataPortability project was running in parallel to the work on WRFS. We invited the two Josh’s to bring their WRFS work into the DataPortability project and as it matured we spun it out again.

If you accept that DP is primarily a symbol for starting the conversation about transforming social networks from walled gardens into interoperating, seamful web services, then no, not really.

This is certainly where it starts – but I think it’s clear that the group has far more potential than that.

… DP does not speak for the community as a whole, for any specific social network (except, perhaps, MySpace), or for any individuals except those who publicly align themselves with the group.

This is also true – The DataPortability project speaks for itself and for the people who participate. There are thousands of people and vendors both large and small who have publicly supported the group and, by extension, given it some level of authority to consult on and develop best practices for the community.

So if the second risk is that an unrealistic, naive or incomplete model of privacy [coupled with a lack of effective enforcement mechanisms in the case of fraud or abuse] will be promoted by the DP group, the third risk is that groups or communities that are roped into the DP initiative may open themselves up to a latent social backlash should something go wrong with specific implementations of DataPortability best practices. Specifically, if the final privacy model demands certain approaches to user data, and companies or organizations go along with them by adopting the provided “social technology stack” (i.e. libraries offered that implement the DP data model), the technical implementation may be flawless, but if people’s data starts showing up in places where they didn’t expect it to, they may reject the whole notion of “data portability” and seek to retreat back to the days of “safe” walled gardens of today. And it may be that, because of the emphasis on specific technologies in the DP group’s propaganda, that brands like OpenID and OAuth will become associated with negative experiences, like downloadable .exes in email are today. It’s not a foregone conclusion in my mind that this future is inevitable, but it’s one that the individual groups affected should avoid at all costs, if only because of the significant progress we’ve made to date on our own, and it would be a shame if ignorance or lack of clear communication about the proper methods of adoption and implementation of these technologies lead people to blame the technology means instead of particular instances of its application.

Open standards are developed as building blocks. The DataPortability project is building something from them. If some of the standards groups would -for some reason – like their standard to be excluded from our recommendations then we would be happy to oblige.

Also, there are a lot of people from all over the world looking at, refining and experimenting with the best practices being developed. I think most would agree that ‘something could go wrong’ is not enough reason not to try working through the challenges to come up with something worthwhile.

What’s good about DataPortability?

I don’t want to just be a negative creep, so I do think that there is a silver lining to the DP initiative, which I mentioned earlier: it provides a token phrase that we can throw around to tease out some of the more gnarly issues involved in developing future social applications. It is about having a conversation.

While OpenID and OAuth have actual technology and implementations behind them, they also serve as symbols for having conversations about identity and authorization, respectively. Similarly, microformats helps us to think about lightweight semantic markup that we can embed in human-friendly web pages that are also compatible with today’s web browsers, and that additionally make those pages easier for machines to parse. And before these symbols, we had AJAX and Web 2.0, both of which, during their inception, were equally controversial and offensive to the folks who knew the details of the underlying technological innovation behind the terms but who also stood to lose their shamanic positions if simpler language were adopted as the conversations migrated into the mainstream.

Agreed. I have often used the example that DataPortability can and will do for open standards what Web 2.0 and AJAX did for CSS, Javascript and XML.

Now, is there a risk that we might lose some of the nuance and sophistication with which we data junkies and user-centric identity advocates communicate if we adopt a less precise term to describe the present trends towards interoperable social networks? Absolutely. But this also means that, as the phrase “data portability” makes its way into common conversation, people can begin to think about their social networking activities and what they take for granted (”Wait, you mean that I wouldn’t have to sign up for a new account on my friend’s social network just to send them a photo? Really?”), and to realize that the way things are today not only aren’t the way that they have to be, but that there is a better way for social applications to be designed, architected and presented, that give the enthusiasts and customers of these services greater choice and greater latitude to actually pick services that — what else? — serve them best!

So just as Firefox gave rise to a generation of web developers that take web standards much more seriously, and have in turn recognized and capitalized on the power of having a “rectangle” that actually behaves in a way that they expect (meaning that it fully complies with the standards as they’ve been defined), I think the next evolution of the social web is going to be one where we take certain things, like identity, like portable contact lists, like better and more consistent permissioning systems as givens, and as a result, will lead to much more interesting, more compelling, and, perhaps even more lucrative, uses of the open social web.

I obviously agree completely here.

It is clear with Chris’ great post, that the data portability conversation, and the DataPortability project has unearthed a fantastic set of questions and opportunities.

The Data Portability narrative, and the resulting questions that it posses, are precisely the tools that will encourage end users, developers, vendors and media to further investigating popular standards like OpenID and Microfomats, and dig deeper into more nascent standards like RDF, XRDS and APML.

The resulting acceleration in just six months has been phenomenal – I look forward to the next six months.

I’ve written more on this subject in my “Internal note of thanks” post.

It’s been a hectic few days. Our little project to create a reference design for Data Portability has been put at the center of a storm when Robert Scoble, video blogger to the stars, experienced his very own Data Portability use case – getting his personal information out of a closed system. In this case, Facebook.

The DataPortability project sort of happened by accident for me. The goal was simple. Having worked hard to create and champion the cause of APML, the FaradayMedia team and I tried to join the broader standards discussion. The problem, though, was that the same questions kept on getting asked over and over, and the answers -while slightly different each time – were always basically the same.

It usually went something like this…

“So how can we use [X format, standard, protocol, technique] to get data [Y] from silo [Z] for purpose [1, 2 and 3].”

“You could use [my personal format of choice] because [I am personally invested in community A].”

“But that only solves part of my problem, what about [B, C and D]”

“Oh we have not really solved that, probably check out community [E, F and G] for that part”.

The result, was very little standards integration work actually being done because while the standard file formats exist, there is no standard way of implementing them end-to-end.

So we started the DataPortability Workgroup with some friends to try and get the story straight in our own heads and share the results with the world.

The world, though, seems to have come knocking before we were quite ready for the attention. But that’s OK. It has only served to re-double our efforts and seems to prove that there was indeed a problem that needed to be solved.

I’d like to personally thank everyone involved and welcome all the new people who have come to join the conversation. It has been an adrenalin packed few days and I have enjoyed every second.

I really feel quite grateful to have connected with so many people who believe in the same things – including personal heroes who have made all this possible with their hard (and often thankless) work to create the standards that will make DataPortability possible. I’d particularly like to assure those people that DP is not about re-inventing what they have done, but rather shining a light on their work by putting it in context for those that need to see the big picture spelled out.

It seems that the web will dramaticlly evolve again this year. It used to be the Web of Pages, most recently it evolved into the Web of People… it seems in 2008 the Web of Data begins to take root.

Look forward to the fun…