Title: Telling Your Story: Autobiographical Metadata and the Semantic Web

Mischa Tuffield

IAM Group

mischa@mmt.me.uk

Slides can be found online http://mmt.me.uk/slides/iam121009/index.html

Your Digital Persona

Digital trails/Digital traces/Digital Footprints
Your identity online
You need to control this, for people can assume information about you, you should be the authority on your own data
This is what I call your lifelog, or your "Digital Persona"

Capturing your Digital Persona at Source : Lifelogging

More and more transaction/social interactions are happening online
This has been labelled 'The Disappearence of the Body'
Our daily lives leave behind more evidence that we can collect and curate, and the indiscriminating collection of such evidence is what has been coined Lifelogging
Lifelogging can either be :
- Passive : storing by-productsof the life one would have lived anyways
- Active : one surrounds oneself with sensors and information capture tools to create as rich a picture of one’s life as possible.

Passive Lifelogging

An example could be our very own Semantic Squirrels Group
The identification of sources of “cheaply available” autobiographical information
Surreptitious capture of autobiographical data
Ethos: Storing information in its raw form, for future utility.
Sources of information identified:
- Calendar: iCal
- Location information: GPS, Network Gazetteer
- File System Information: PDFs, Documents
- Web History information: Firefox
- Email Information: Mbox
- Media Playlist Information: Music
- Contextual Info: Weather and News metadata

Active Lifelogging : MyLifeBits (1)

MyLifeBits: M$R's personal database for everything
Gordon Bell's baby, well Gordon and his many assistants...
The SenseCam device

Active Lifelogging : MyLifeBits (2)

Active Lifelogging : MyLifeBits (3)

Others active in this space

Alan Smeaton's Group Dublin City
The Lifelog project from DARPA, killed off by human right's enthusiasts
CARPE Workshops at ACM Multimedia
Total Recall book out now
The Memories for Life Network

Lifelogging & Empowerment (1)

Don't trust people to store your data on your behalf
Capture your own context and your own content
Store your own data, give yourself a WebID, and use that as the subject whenever you want to create data about yourself
Garlik FOI request report
Store your own data and use pushback technology like mhausenblas's RDF -> API RDF Pushback work
Lifelogging: Privacy and Empowerment with Memories for Life
Rutgers Uni., Hasan Elahi, who was arrested in 2002 on serious terrorism allegations despite being absolutely innocent of any criminal or terrorist activity, has taken to lifelogging and posting the information on the Web as a pre-emptive alibi, see: http://trackingtransience.net/
JenniCam : A camera with a view the experiment was meant to enpower women ...

Lifelogging & Empowerment (2)

Check out your online persona: at MIT's Personas
It is a shame that they can get it really wrong

So how does Personal Information fit in with the Semantic Web

Associative Querying
My favourite TimBL picture :

The Semantic Web Layercake

The new Semantic Web Layercake!?

Semantic Web / The Web of Data 1/2

The Resource Description Framework (RDF) -triples. MIME-types:
- n3 text/rdf+n3
- ntriples text/plain
- turtle application/x-turtle
- RDF-XML application/rdf+xml
Shared Conceptualisations/domain models/ontologies
- A Cat is_a Mammal, Mammals give birth, ...
- Person is an Agent, Agents interact with their environment, A Person can have friends, A person has an age of type integer, with a cardinality of > 0

Semantic Web / The Web of Data 2/2

Uniform Resource Identifiers (URI)

Who knows what a URI is?

A URI is a compact sequence of characters that identifies an abstract concept or a physical resource - RFC3986
foo://bar.com:8001/boo/x?something=value#fragment
\___/\___________/\____/ \_____________/ \______/
scheme authority path query fragment
URIs are NOT merely URLs!
And I should stress that cool ones don't change
- http://
- mailto:
- tag:
- file://
- isbn:
- urn://
- ...

RDF isn't that bad ...

RDF is not simply a flavour of XML, but it can be serialised in XML, but it is very ugly

<?xml version="1.0" encoding="utf-8"?>
<rdf:RDF
	xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
	xmlns:foaf="http://xmlns.com/foaf/0.1/">
 <foaf:PersonalProfileDocument rdf:about="">
	<foaf:primaryTopic rdf:resource="http://mmt.me.uk/foaf.rdf#mischa"/>
 </foaf:PersonalProfileDocument>

 <foaf:Person rdf:ID="mischa">
	<foaf:homepage rdf:resource="http://mmt.me.uk/"/>
 </foaf:Person>
</rdf:RDF>

It can be serialised in other ways to make it easier to read ...

 @prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
 @prefix foaf: <http://xmlns.com/foaf/0.1/> .
  <> a foaf:PersonalProfileDocument ;
  	 foaf:primaryTopic <#mischa> .
  <#mischa> a foaf:Person ;
	foaf:homepage <http://mmt.me.uk/> .

It can even more verbose:

    <http://mmt.me.uk/foaf.rdf> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/PersonalProfileDocument> .
    <http://mmt.me.uk/foaf.rdf> <http://xmlns.com/foaf/0.1/primaryTopic> <http://mmt.me.uk/foaf.rdf#mischa> .
    <http://mmt.me.uk/foaf.rdf#mischa> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> .
    <http://mmt.me.uk/foaf.rdf#mischa> <http://xmlns.com/foaf/0.1/homepage> <http://mmt.me.uk/> .

So what does all of this mean?

Represent your data in triples, use unique identifiers, and make use of as many shared conceptualisations as you can
So what are triples?: Subject Predicate Object
Implied semantics in column name in a class db
And this is very similar in form to the simplest of English sentences
some guy called X has a homepage X

 <#personX> foaf:homepage <http://foo.com/bar> .

Need to be able to bung any Class/property URI into a web browser to get its description

Content Negotiation

Show /Music example on the BBC

curl -I http://www.bbc.co.uk/music/artists/cc197bad-dc9c-440d-a5b5-d52ba2e14234

Return "text/html"

curl -I -H "Accept: application/rdf+xml" http://www.bbc.co.uk/music/artists/cc197bad-dc9c-440d-a5b5-d52ba2e14234

Return "application/rdf+xml"

http://blog.dbtune.org/post/2009/03/24/A-sneak-peek-at-the-BBC-Music-RDF via Yves Raimond
I generate my homepage from my FOAF file, I just edit it in the foaf builder thing and I write back via webdav, and to OAuth (for private data)

Knowledge Representation and shared conceptualisations

AI winter
CYC project
Wikipedia ... DBpedia the consensus vote ...
Could this be leading us to a Universal Vocabulary?

The Picture 2 Years ago ...

The Picture as of last year ...

The Picture Now

Ontomedia Ontology (1)

http://purl.org/ontomedia/core/media
Build an ontology for describing stories

Ontomedia Ontology (2)

http://contextus.net/
Build an ontology for describing stories

Yves' Event Ontology

http://motools.sourceforge.net/event/event.html
An ontology for describing events

Sources of Information where people are leaving their digital trails' anyway...

Mbox/Messaging
Music
WebBrowsing
Geolocation (IP gazetteers e.g. skyhock)
Social Network Info (FOAF - must most likely facebook, twitter, myspace, ...)
Nepomuk SemanticDesktop in KDE 4.0 File Reading preferences
Radio/BBC Programmes style data
Blog Info

Augmenting context with external datasources

Human memory, associative linking in memory
Lateral thinking
Context could include:
- Weather Info
- Day/Night Info
- Indoor/Outdoors Info
- News Info
- Traffic Info/on one's route to work...

Augmenting context with content 1

User generated content such as : pictures, videos, podcasts ... could give us further metadata
Face detection Hue, Intensity, Texture (HIT) map Enhancement: Eigen-Faces Algorithm

Augmenting context with content 2

User generated content such as : pictures, videos, podcasts ... could give us further metadata
Natural/Artificial -- City/Landscape

Augmenting context with content 3

Focus Map Info, which part of the image is the main focal point?

Mor Namaan, ZoneTag 1

How well remembered...

Mor Namaan, ZoneTag 2

How useful ...

How would you do this?

FOAF : Documents on the web describing people and how their friends are
Public / Private : via OAuth / FOAF+SSL
An index of FOAF files, to give you links in, otherwise you would only have links out ....
Associate the Contextual Information, with the Content, that it to your WebID/FOAF Person via RDF
Using Event Ontology, geoLocation Ontology, soic ontology, and so on ...

In order to

Not have to learn yet another API
Have a decentralised social network, where people get control over their own data
And they can always pushback data to today's "in" social network at a given time
Creation of autobiographical metadata, a legacy, a definitive collection of facts regarding a human
Unified Language to tasks easier :
- integration/smushing/mashing up
- distributed query
- content generation

FOAF : The Friend-Of-A-Friend Ontology

'The Friend of a Friend (FOAF) project began early in 2000 as an "experimental linked information project", created by Dan Brickley and Libby Miller.'
RDF : http://xmlns.com/foaf/0.1/
HTML : http://www.foaf-project.org/
FOAF makes it possible for people to build large scale, decentralised, open social networks that are controlled by individual users.
Sites such as : LiveJournal, hi5, vox, friendfeed?, google???,...
Reflectors : twitter, flickr, lastfm, delicious, ...

The FOAF Landscape as per Q1 2009

Foaf blob

Overview (a Steve-ism)

Viewer (1): http://foaf.qdos.com/

HTML view of a FOAF PersonalProfileDocument
Includes a list of friends
Includes a view of who claims to know the given foaf:Person
Caters for searching on FOAF IFPs (what is an IFP?)

Viewer (2): http://foaf.qdos.com/find/?q=http://planb.nicecupoftea.org/

Builder (1): http://foafbuilder.qdos.com/

RAP
AJAR(ish)
SPARQL
SPARQL-PROTOCOL to 4-store
A Foaf Editor which allows you to :
- Search for a FOAF file
- Build and store a FOAF file
- Edit their own existing FOAF file
- Manage privacy and permissions
- Provision of a service that allows people to search and browse millions of FOAF files in a user friendly way
- Edit / Store Personal Info in both a Public and Private Manner

Builder (2): http://foafbuilder.qdos.com/

Get your location via GUI

Builder (2): http://foafbuilder.qdos.com/

Write to WebDAV, save the file to your machine, ...

Builder (3): http://foafbuilder.qdos.com/

Get the RDF out of the FOAF builder

Private foaf.qdos.com http://private.qdos.com/

Get your own FOAF OAuth endpoint with your OpenID URI
Allows for private FOAF data to be stored and retrieved from an OAuth endpoint

Forward Search: http://foaf.qdos.com/forward/

Entering a unique identifier for a foaf:Person (i.e. email address, mbox sha1sum, homepage, weblog, or a FOAF URI) will return FOAF RDF listing foaf:Persons which the identifier claims to know.
Parameters : path and ifp
Example 1: http://foaf.qdos.com/forward?path=http://danbri.org/&ifp

<http://users.ecs.soton.ac.uk/nrs/foaf.rdf#me>
    a foaf:Person ;
    foaf:knows [
        a foaf:Person ;
        foaf:mbox_sha1sum "965c47c5a70db7407210cef6e4e6f5374a525c5c" ;
        foaf:name "Tim Berners-Lee"
    ], [
        a foaf:Person ;
        foaf:mbox_sha1sum "26a374ad4de937252c044f7dd45aa48ecbdb4f16" ;
        foaf:name "Steve Harris"
    ], [
        a foaf:Person ;
        foaf:mbox_sha1sum "28339a9a36ee4e330da9613958efb89e2961c6cb" ;
        foaf:name "Nick Gibbins"
    ], [
        a foaf:Person ;
        foaf:mbox_sha1sum "ca2d238d1ade1efb7128874e99e84fdef5a3c447" ;
        foaf:name "Tom Heath"
    ] .

Example 2: http://foaf.qdos.com/forward?path=http://moustaki.org/foaf.rdf%23moustaki

SameAs Search: http://foaf.qdos.com/sameas/

To get owl:sameAs triples about a given foaf:Person according to their FOAF presence enter their URI, email address, mbox sha1sum, homepage or blog URL above and click 'Go'.
Entering a unique identifier for a foaf:Person (i.e. email address, mbox sha1sum, homepage, weblog, or a FOAF URI) will return FOAF RDF listing the URIs we think are owl:sameAs.
Parameters : path and ifp
Example 1: http://foaf.qdos.com/sameas?path=http://danbri.org/&ifp

<http://danbri.org/foaf.rdf#danbri> a foaf:Person .
<http://danbri.org/foaf.rdf#danbri> owl:sameAs _:genid1 .
_:genid1 a foaf:Person .
_:genid1 foaf:homepage <http://danbri.org/> .
<http://foafbuilder.qdos.com/people/danbri.org/foaf.rdf#danbri> a foaf:Person .
<http://foafbuilder.qdos.com/people/danbri.org/foaf.rdf#danbri> owl:sameAs _:genid2 .
_:genid2 a foaf:Person .
_:genid2 foaf:homepage <http://danbri.org/> .
<http://www.advogato.org/person/danbri/foaf.rdf#me> a foaf:Person . 
<http://www.advogato.org/person/danbri/foaf.rdf#me> owl:sameAs _:genid3 .
_:genid3 a foaf:Person .
_:genid3 foaf:homepage <http://danbri.org/> .

Example 2: http://foaf.qdos.com/sameas?path=http://plugin.org.uk/swh.xrdf#me
Similar in vain to Hugh/Ian's http://sameas.org/

Reverse Search: http://foaf.qdos.com/reverse/

Entering a unique identifier for a foaf:Person (i.e. one of the IFPs email address, mbox sha1sum, homepage, weblog, or a FOAF URI) will return FOAF RDF listing the people which claim to know the identifier presented.
Parameters : path and ifp
Example 1: http://foaf.qdos.com/reverse?path=http://danbri.org/&ifp
Example 2: http://foaf.qdos.com/reverse?path=http://tomheath.com/id/me

<http://tomheath.com/id/me> a foaf:Person .

<http://nxg.me.uk/norman>
    a foaf:Person ;
    foaf:homepage <http://nxg.me.uk>, <http://www.astro.gla.ac.uk/users/norman/> ;
    foaf:knows <http://tomheath.com/id/me> ;
    foaf:mbox_sha1sum "0254b43a4c00a8c5eb9093d9820353640ee02786", "14f2d3a469303d0faca13f73064845ddda4d2dbd", 
     "58a587e433b1e0c22aa026eeee7703ffcee6262c","bfeee75c2025815392014a95cfd4b6aad117c07f", 
     "84612b3540a255bb11de3db579e02533ff2631c5", "baa162e14a20b3fafbccbf0fceaa1159a3a042d1",     
     "c9994fd3713561d0d9a468cd30c11a0f3cb3055a", "e6578555a8108ea83ee7f1d60556e63fd83bcc5e" ;
    foaf:name "Norman Gray" .

[]
    a foaf:Person ;
    foaf:homepage <http://kmi.open.ac.uk/people/mikele> ;
    foaf:knows <http://tomheath.com/id/me> ;
    foaf:mbox_sha1sum "97ddc048d1a7df5e6fcb8f530777896a395d3dc1" ;
    foaf:name "Michele Pasin" .

<http://www.aelius.com/njh#me>
    a foaf:Person ;
    foaf:homepage <http://www.aelius.com/njh/> ;
    foaf:knows <http://tomheath.com/id/me> ;
    foaf:mbox_sha1sum "3f361af12a473b48852819e3ff9153783149a26a", "a8476e8096db2bde20a734c8446bb3d60befea2b" ;
    foaf:name "Nicholas J Humfrey" .

So how is this useful..?

Try adding the following triples to your foaf file:

<#me> rdfs:seeAlso <http://foaf.qdos.com/forward?path=http://foo.com/blog&ifp>
<#me> rdfs:seeAlso <http://foaf.qdos.com/reverse?path=http://foo.com/blog&ifp>
<#me> rdfs:seeAlso <http://foaf.qdos.com/sameas?path=http://foo.com/blog&ifp>

OpenID Social Verifier (1): http://foaf.qdos.com/verify-about

The service is implemented as a RESTful HTTP service.
You send requests to the service with an identifier for you and the OpenID you wish to verify.
If the OpenID is within 2 people of you then the service returns YES, and the distance between you and them, 0 being an ID for you, and 2 being 2 people away, for example:
```
  <verify>
  <result degree="2">YES<result>
  <verify>
  
```
The endpoint of the REST service is http://foaf.qdos.com/verify and the arguments are action, qdosuri, ifp, ifpval and openid.
action Check or List

OpenID Social Verifier (2): http://foaf.qdos.com/verify-demo

Validator: http://foaf.qdos.com/validator/

Checks to whether a RDF document makes correct use of the FOAF ontology

4store: http://4store.org/

4store, an efficient, scalable and stable RDF database
Steve's baby...
Run, both the public and private foaf indexes, on an 8 node cluster
Queries to private data limited by Graph URIs
For info/help come on irc://irc.freenode.net/#4store / visit website
For tutorials and future events visit : http://4store.org/trac/wiki/tutorials or mail Steve

Future Direction

Full Text Search over FOAF files
Grab all of it !
Server to Server updates : XMPP JQbus?
OAuth which Interacts with 4store code to be released
Write Data out of FOAF builder to any OAuth
More Robust Triangulation option
FOAF+SSL for sign-on
Continual Update
Release code snipbits for people to ping to the FOAF KB http://foaf.qdos.com/ping
Release stats on connectivity and richness of FOAF data from different sites
Find time and Write a paper :)

Name checks

Privacy and Internet Stuff

Kieron O'Hara

Semantic Logger / Photocopain Work

Antonis Loizou
David Dupplaw
Steve Harris

Ontomedia Work

Mike Jewell
Faith Lawrence

FOAF work

Nick Lamb
Luke Wilson-Mawer
Steve Harris

Get involved

Tracks at WWW conferences (Linked Data on the Web 2009) is a good place to start
International Semantic Web Conferences
ESW wiki at the W3C
#swig on irc.freenode.com
This talk can be found at this URL http://mmt.me.uk/slides/iam121009/index.html
Questions ?

Title: Telling Your Story: Autobiographical Metadata and the Semantic Web

Your Digital Persona

Capturing your Digital Persona at Source : Lifelogging

Passive Lifelogging

Active Lifelogging : MyLifeBits (1)

Active Lifelogging : MyLifeBits (2)

Active Lifelogging : MyLifeBits (3)

Active Lifelogging : MyLifeBits (3)

Others active in this space

Lifelogging & Empowerment (1)

Lifelogging & Empowerment (2)

So how does Personal Information fit in with the Semantic Web

The Semantic Web Layercake

The new Semantic Web Layercake!?

Semantic Web / The Web of Data 1/2

Semantic Web / The Web of Data 2/2

RDF isn't that bad ...

So what does all of this mean?

Content Negotiation

Knowledge Representation and shared conceptualisations

The Picture 2 Years ago ...

The Picture as of last year ...

The Picture Now

Ontomedia Ontology (1)

Ontomedia Ontology (2)

Yves' Event Ontology

Sources of Information where people are leaving their digital trails' anyway...

Augmenting context with external datasources

Augmenting context with content 1

Augmenting context with content 2

Augmenting context with content 3

Mor Namaan, ZoneTag 1

Mor Namaan, ZoneTag 2

How would you do this?

In order to

FOAF : The Friend-Of-A-Friend Ontology

The FOAF Landscape as per Q1 2009

Overview (a Steve-ism)

Viewer (1): http://foaf.qdos.com/

Viewer (2): http://foaf.qdos.com/find/?q=http://planb.nicecupoftea.org/

Builder (1): http://foafbuilder.qdos.com/

Builder (2): http://foafbuilder.qdos.com/

Builder (2): http://foafbuilder.qdos.com/

Builder (3): http://foafbuilder.qdos.com/

Private foaf.qdos.com http://private.qdos.com/

Forward Search: http://foaf.qdos.com/forward/

SameAs Search: http://foaf.qdos.com/sameas/

Reverse Search: http://foaf.qdos.com/reverse/

So how is this useful..?

OpenID Social Verifier (1): http://foaf.qdos.com/verify-about

OpenID Social Verifier (2): http://foaf.qdos.com/verify-demo

Validator: http://foaf.qdos.com/validator/

4store: http://4store.org/

Future Direction

Name checks

Privacy and Internet Stuff

Semantic Logger / Photocopain Work

Ontomedia Work

FOAF work

More linkage

Get involved