Data Unbound

As I prepare my JCDL 2008 Tutorial (Creating and Enabling Data Mashups), might I make use of Eric Lease Morgan's XML in libraries: A workshop?

Of note is an upcoming workshop aimed at libraries — CARL-IT North: Mashup the Library: An introduction to mashup technology and the art of remixing library and information resources.

codepad:

codepad.org is an online compiler/interpreter, and a simple collaboration tool. Paste your code below, and codepad will run it and give you a short URL you can use to share it in chat or email.

I'd like to experiment with it to see whether it's a good place to paste code fragments that I want to share (and run!). I also want to think through how it sandboxes runnable code.

A friend sent me a link to a recent post by Brad Templeton, Data hosting instead of data portability:

A data hosting approach has your personal data stored on a server chosen by you. (You might have that server right in your own house, or pay for hosting services.) If you pay, that server’s duty is not to exploit your data, but rather to protect it. That’s what you’re paying for. You can have more than one (with different personas, if you like) but for now let’s imagine having just one.Your data host’s job is to perform actions on your data. Rather than giving copies of your data out to a thousand companies (the Facebook and Data Portability approach) you host the data and perform actions on it, programmed by those companies who are developing useful social applications.

I find data hosting appealing and would like to shift towards hosting my own data as opposed to having my data hosted elsewhere. It's a matter of making it practical though.

For instance, I'm a big fan of Flickr because it makes it so easy to have my photos taken care of. But ideally, I'd like to host my own photos and directly control how people access them. I'd do that if I could build a good repository and layer services on top of them — just like Flickr. But Flickr has an economy of scale that I don't have — it can solve that problem and provide the solution to many people.

Now, it's possible that we can solve that problem too and sell and/orr share it to lots of people so that they can do more of their own data hosting. Is that a business that I would want to be in?

In January, a correspondent, having heard that I was about to publish a book on mashups, wrote me, saying that he would "love to find out more what [I'm] thinking". Flattered to be asked, I replied. Here I quote an edited version of what I wrote. (I tend to like what I write in email because my writing tends to be energetically conversational.)

Let me tell you a bit of what I'm thinking and where I'm coming from. Obviously, I think that the topic of mashups is a big deal given my willingness to write a whole book about it. The element that excites me most is the power that individuals and small groups of people now have to recombine data and services — to use mashups to make sense of the world — particularly in the corner of the world in which I'm immersed (teaching, learning, and research in the context of higher education, libraries, and museums). When I first learned about XML and web services, I thought — wow — this is going to change the way we do research and way we teach and learn. I spoke about this topic at the O'Reilly ETCon in 2003.

I've built a research prototype (called the Scholar's Box) to enable scholars to gather data from different sources, create personal collections, and share them with others. (I'm an advisor to a project called Zotero (http://www.zotero.org/) — which provides a Firefox plugin to enable people to manage bibliographic collections within the web browser — and ultimately to share their collections.)

I teach a course at the School of Information at UC Berkeley call "Mixing and Remixing Information". This semester will be the third term I teach the course. It's a project-based course, in which the focus is on helping students build their own mashups (see http://blog.mixingandremixing.info/s08/class-projects/ for some mashups from [this] year's class) . A good number of my students have next-to-no experience with web programming. I have found that showing students the power of mashups — to get people excited about the possibilities — and then teach them how to make mashups is an excellent way into web programming. I've taken this approach with teenagers with some success last summer — I taught a six week course on the Berkeley campus.

In addition to master's students this semester, I'll be teaching a six week hands-on course to campus IT staff about building next-generation campus IT services — again by studying things like Flickr and Google maps and Yahoo! Pipes, getting them to build mashups, and thinking about how we can do things like that on campus — for administration and for research.

Now that I'm finished writing my book, I'm thinking about other opportunities. Perhaps it's just the geek in me, but I really do think that some combination of Web 2.0 mashups, a bit more rigor from SOA, imagination, and some understanding of real problems can transform the worlds of education and research (and other worlds too — but education and research are something I know about.) I'm setting out to build a small company whose goal is to help the educational community effectively use Web 2.0 ideas (with a specific emphasis on remixability) to change the way we do things in that community. I will confess that my business plan still needs to be written, however…. In the meantime, I'm experimenting with a mix of teaching, consulting, and building software. (Some collaborators and I have a grant proposal in to enhance the teaching and learning of art history by integrating Flickr into the computational fabric of the classroom.) Most of all, I believe in the power of ideas — hence, I wrote a book to teach others.

Lots of questions remain however. (Now that my teaching jobs have come to an end, I now have some serious amounts of time to plot out my next steps. Writing is a great help to me in sorting out my thoughts, especially when I'm writing for a public audience. I would like to build a business but am unclear on exactly what it should look like. Undoubtedly, there will be details that would be unwise for me to share publicly– but I believe that a lot of my thinking would benefit from putting my ideas out there.

Here's an update on my current professional activities that I hope will give you, my readers, a sense of where this blog will be heading:

• My book Pro Web 2.0 Mashups: Remixing Data and Web Services was published by Apress on February 25, 2008.  It's gotten some good reviews, and I've heard from some happy readers. It's time, however, for some more intense promotion of my book to make sure it fully reaches the audience it is meant to serve. (Most of my book-related activities will be discussed at my MashupGuide blog.)

• In April, I finished teaching a six-week course (“Building Next-Generation Campus Information Services” for IT staff on the Berkeley campus. “The course designed to introduce campus professionals to the concepts of Web 2.0, XML, web services, and elements of web application development through the lens of mashups. While completing a six-week long project, participants will advance their knowledge and abilities, and gain insight into potential solutions to the information management needs they face on the job.” I plan to post more details about the course, including how it was structured, what projects came out of the class, and how I think this course can be improved.

• Last week marked the culminating open house of the Mixing and Remixing Information course I teach at the School of Information at UC Berkeley. I had a blast teaching the course for the third time though I wonder whether it's time for a total (or at least substantial ) revamp of the course.

• I've started to contribute regularly to ProgrammableWeb, which I described in my book as “the most useful web site for keeping up with the world of mashups, specifically, the relationships between all the APIs and mashups out there."  That was before I started writing for it!  See the posts I've written for PW so far.

• Finally, I've recently become the Integration Advisor for the Zotero Project, working on developing developer documentation for them, thinking about how to integrate Zotero with other things (in a sense, Zotero as a client-side mashup platform) — specifically in the context of Zotero-Internet Archive alliance.  My work for Zotero will be a big part of what I'll be discussing on this blog.