Slashdot Log In
RDF For Desktop Metadata?
Posted by
timothy
on Sat Jul 03, 2004 06:57 PM
from the lateral-migration dept.
from the lateral-migration dept.
claes writes "There is an article "Metadata for the desktop" that suggests that RDF should be used to describe data in desktop environments. This is an interesting idea. RDF is already used by Creative Commons to attach license metadata to its works. Mozilla also supports it.
RDF was designed for the web, but can it also find its way to the desktop? And what metadata is most important to describe?"
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
The killer app for metadata on the desktop (Score:5, Funny)
Suppose today I want to see shaved asian hardcore action. Now provided that metadata searches are integrated into the OS(like they will be in Tiger), all I need to do is a quick metadata search on my hard drive and boom, there is what I am looking for.
I mean provided there was a decent standard(a porn standards body would rule!) and good regex capabilities built into the OS, I would be willing to pay for porn. I know that there are comments built into the jpeg standard, but there are all sorts of porn file formats, it would be helpful to have a universal standard across them. It saves time, beats trying to search on google and going through a lot of crap just to get to something good. I am a man on the run, I have places to go, I can't be bogged down by my porn. Plus, think of the people that get to catagorize this stuff(well, the fun stuff anyway, not goatse), what an awesome job that would be!
I should probably post AC, but I figure this post is bound to earn me at least one fan and/or freak.
Re:The killer app for metadata on the desktop (Score:5, Funny)
Just check your email. If it's not there now, it will be soon enough.
Parent
Re:The killer app for metadata on the desktop (Score:2)
Are you, perchance, a geek?
Re:The killer app for metadata on the desktop (Score:2)
I guess even moreso in that I watch but, have yet to participate in it.
Geek squared!
Calling Autopr0n! (Score:3, Funny)
Definition:...? (Score:5, Interesting)
Re:Definition:...? (Score:2, Informative)
Re:Definition:...? (Score:2, Insightful)
Re:Definition:...? (Score:4, Insightful)
I don't see with the thread started wanted a definition by Slashdotters in the first place, since it's already pretty well described [wikipedia.org] and AFAIK the word doesn't have several meanings.
Parent
Re:Definition:...? (Score:3, Informative)
Say you have a digital photo. It's from a vacation you took in 2002, to hawaii, and contains photos of you, your partner, one of your children, but not your other kids and no pets. All that info could be kept as metadata of those pictures, and more.
The same can be done for finance info for the year 1999 for you, or 2001 for your partner, or music files bought from a certain place, by a certain artist and band.
While each of the filetypes above can have their own metadata (exif for images, co
Re:Definition:...? (Score:2)
Re:Definition:...? (Score:3, Funny)
Re:Definition:...? (Score:2)
Implicit feedback for filesystem information (Score:4, Informative)
The big concern is keeping this data protected and private. You dont want to share all of your metadata with everyone, so security of these systems should be something to look at carefully.
What happened to forked files? (Score:5, Insightful)
While MacOS was at a disadvantage being one of the only ones to use it, wouldn't it have been an excellent advantage for ALL filesystems to be forked?
(I don't know the answer to this - anyone who knows more about filesystems, give your thoughts)
Re:What happened to forked files? (Score:2)
NOTE: take this with a grain of salt, I know very little about filesystems.
Re:What happened to forked files? (Score:5, Informative)
I think the new filesystem WinFS in Longhorn is basically just an evolution of NTFS streams to make them more accessible for the users. They've always been there, just not very accessible besides a limited set of text fields in the file properties dialog box in Windows. (i.e. they've always been able to hold custom data and have custom key names)
Parent
Re:What happened to forked files? (Score:3, Informative)
Well, one problem immediately springs to mind: The translation between different metadata formats. It's already a pain in the butt when using transferring files of not-so-popular types to the Mac.
The second gripe I have with the Mac is that it's so friggin' hard to edit the metadata. AFAIK you can't even do it on OS 9 without software. Now assuming the user
Re:What happened to forked files? (Score:3, Insightful)
> for ALL filesystems to be forked?
Yes, but the trouble of compatibility remains. But there is a simple solution for this: fork as dir bundles: Instead of a file with a metadata fork you simply put the metadata file and the datafile into a dir and give that folder the name of the datafile. The current users copy the dir around and use its contents. But modern OSes treat the dir as if it is the datafile when the user interacts with it.
The metadata file sa
Re:What happened to forked files? (Score:2)
Re:What happened to forked files? (Score:2)
Integration (Score:5, Interesting)
What is wrong with you people? (Score:2, Insightful)
But why oh why do people think that XML-based solutions is the way to go? An RDF solution would be bloat beyond belief. Ok, so it's not that bad for a few files, but when we get down to it - we don't have just a few files. We have plenty of them.
So why not use something smaler? A simpler protocol?
We can still have RDF-frontends for those that crave their daily XML-fix. Get real.
Re:What is wrong with you people? (Score:2)
RDF primer [w3.org]. At first I thought it was extremely overcomplicated, but after reading some more I started to grasp the concepts. And they are not about storage formats. They are about semantics.
How much do you pay for HDD's (Score:2)
I have 300,000 files on my Windows box (Score:3, Informative)
The vast majority are very small files. How much more space would be required to give each one some RDF? And remember disk space is allocate in terms of sectors, or sometimes in blocks of several sectors, so small files waste proportionately more space.
And that's just on the Windows installation for my PC. I also have Slackware Linux and BeOS on other partitions. Quite likely there are very nearly a million files on my PC alon
This is largely irrelevant if you have experience (Score:4, Insightful)
For one thing, I always give my filenames relevant titles, not things like document06.doc.
Also, I already know how to search through files for content using basic grep or advanced Windows searching.
I mean, sure, meta data like ID3 tags for MP3s that I steal offline are important because my Nomad mp3 player indexes based on that info, but in general I'd say meta data is not quite as important as some may suspect.
Re:This is largely irrelevant if you have experien (Score:2)
FS support for metadata (Score:5, Interesting)
I've heard the NTFS file system is designed to allow the system to add any number of properties (besides the obvious filename, last access time and permissions) to any stored file. This is likely to be exploited by Longhorn, which is planned to be capable of appending metadata to newly created files (for example, if you download a file from the Internet, the system would likely append a Originated-From-URL property to it).
What I wonder is, is there any filesystem in the FOSS world that supports something like this, or are there plans to make it supported before 20??, when Longhorn hits the stores? I see this as a critical feature that must be made available by non-Windows OSes.
Re:FS support for metadata (Score:3, Insightful)
Longhorn is using WinFS, which afaik is just a metadata layer slapped on top of NTFS.
Re:FS support for metadata (Score:2)
The storage engine for WinFS will come from the mssql team so thats hardly "slapped on top"
Re:FS support for metadata (Score:5, Informative)
Actually, you can. To add a metadata item called "hidden.txt" to a file called picture.jpeg, just type on the command line:
notepad picture.jpeg:hidden.txt
Notepad should say that it "created the file." You should notice that no new files have been created: just look for them with explorer. But you can later open this "file" and read and edit it.
You can do this with any file with any metadata name.
Parent
NTFS streams (Score:3, Informative)
If you move the file around the NTFS drive, or from one NTFS drive to another, then yes, the metadata goes with it. If you move it to a FAT volume though, the metadata is lost forever. Not a huge deal as NTFS is getting more and more users nowadays.
XP uses these metadata streams to some degree, actually. Some of the things in the properties page for a file are actually NTFS streams.
Longhorn will make more extensive
Re:FS support for metadata (Score:2)
Streams don't look too hard to deal with, it was just an ignored feature, like Windows Scripting, no few paid attention until it was exploited with a virus.
Re:FS support for metadata (Score:3, Informative)
let's keep the Meta data simple... (Score:4, Insightful)
What
Where
When
Why
and possibly How...
Spotlight (Score:2, Interesting)
Re:Spotlight (Score:3, Informative)
The search technology in Spotlight probably is inspired by live query from BeOS but first appeared at Apple in iTunes and later Preview for Panther.
Many former Be Inc. employees work at Apple now and some had worked at Apple before joining Be.
Can't wait.. (Score:3, Funny)
Re:Can't wait.. (Score:2)
It would be good for doing things like grepping, but I wonder if a system-wide SQ
Re:Can't wait.. (Score:2)
Or as another example, for a "various artists" album you could have the songs available as
Re:Can't wait.. (Score:2)
discussions about winfs and rdf (Score:3, Interesting)
Haystack and Metadata efforts (Score:5, Interesting)
I have to say, their ideas are intriguing, but after using it... I think the big shortcoming is that it's tough to come up with a generalized user interface for manipulating any data thrown at it. Haystack tries at this, and I think, fails at providing any kind of cues or context that tells you what your are dealing with. In Haystack, every task and piece of information you deal with looks very much like every other piece of data, because, as a design choice, Haystack every piece of data has the same rank as every other piece of data.
Having different applications for different types of data usually make sense, if only to limit the amount of options presented to the user so they can make an intelligent decision about what action they want to perform. See this article on Slashdot about how users need limited [slashdot.org] since it makes decision-making too difficult psychologically.
Inevitably, discussions around RDF and metadata always devolve into hand-wavy discussions on how the computer will be able to "magically" do smart things based on the metadata. But it really isn't magic and it isn't automatic at all. Equivalencies and mappings have to be created by humans along with the rules about what to do.
RDF uses many concepts from AI research. Anybody who has read about this branch of computer science knows that the discipline has pretty much given up on creating AI in the 'sci-fi' sense as an impractical dream. That's what makes the Loebner prize [loebner.net] so controversial. I don't expect that computers will be intelligent enough able to relieve users of too much of the burden in assigning metadata.
RDF is a promising approach, but if you read the article, it makes a lot of assumptions about what needs to happen to make the benefits real. Among them are establishing standards for what metadata fields apply to different types of objects: photos, people, music, etc. That kind of standardization won't happen overnight, if at all.
The computer also needs to know what to do when it encounters that kind of data. The article mentions MIME and browsers and, in effect, says the browser can make a rational decision even if it hasn't seen a particular MIME type before. That isn't really true.. you have to install a plugin that tells the browser what to do, or have a registry that someone has put together where the browser can install the right plugin at the right time.
That said, KDE's unification of contact information and passwords does show some of the promise of metadata efforts. And Apple's Spotlight looks like a good solution as far as it goes. I guess I'm just trying to make the point that the magic of metadata needs to be taken with a fairly large hunk of salt.
Many community websites don't permit RDF (Score:3, Interesting)
But when I tried to publish one article at Kuro5hin, the RDF code, which took the form of HTML comments, was displayed literally in the visible body of my article. That is, all the tags had been turned into entities so the tags appeared literally in the rendered text.
I think Kuro5hin's Scoop content management system doesn't permit HTML comments. Maybe it's not trying to suppress comments, but it didn't occur to scoop's developers to allow them.
RDF on the web would likely be much more popular if one could count on publication sites allowing it in the submitted markup.
Another problem I had is that Creative Commons' recommended way to apply a license to a web page is not permitted by any of the community sites I frequent. CC-licensed web pages usually have a small banner that links to the license text. But for obvious reasons, sites like Slashdot and Kuro5hin don't permit images in article or comment submissions.
The result is that, even for the copies of my articles on my own website [goingware.com], I use neither RDF nor the CC banner, because I want to make it easy for others to copy my CC-licensed articles to site that don't permit RDF or graphics.
The way I apply the license is the much-less-cool method recommended for plain text files. I have the following text appear in the body of my articles:
Re:Many community websites don't permit RDF (Score:3, Informative)
Isn't it the same problem? (Score:4, Insightful)
But that's the problem! If it's not fun to organize items into folders, how is it anymore fun to add metadata to a file? I'm not talking about text files. Text files are easy, because you can pull the metadata out of them automatically (in fact, you can do this now with search tools). I'm talking about files that have to be explicitly tagged with metadata, like pictures. How is adding metadata to each picture file to categorize your vacation pictures any less laborious than placing the vaction pictures into their own directory?
That's the problem as I see it. You still end up being a filing clerk! If people don't even organize their folders now, are people going to use metadata when it's available? Will improved search capabilities make users want to be clerks?
In a nutshell, isn't it the same problem?
Re:Isn't it the same problem? (Score:3, Insightful)
When I was a kid and would ask aloud where something was, my mum would say, "Look where you put it." It annoyed me to no end, of course, but years later I find myself "putting things where they belong" and emptying my mind of everything else, much like putting phone numbers in a phone book so one doesn't have to clutter up one's my mind remembering any of them.
My own opinion is that there is no substitute for "putting things in folders." Boring, but true. Regular expressions and databases can go a long
Watching the XML kiddies reinvent the wheel (Score:4, Informative)
Knowledge representation via "is-a" links has been tried, and it breaks down rather quickly. Read "Artificial Intelligence meets Natural Stupidity", by Drew McDermott, for a 20 year old critique of this concept. It's overkill for searching, and not powerful enough for reliable automated question answering.
The Cyc debacle [cyc.com] illustrates how much work you have to put into tagging to get very little out. After twenty years of that money sink, it's still useless.
RDF (and OWL) in Pike (Score:4, Interesting)
I noticed the article made no mention of Pike (also the name of a fish - see language logo). Pike's a fine C-like scripting language ...that I know extremely poorly myself, but anyway..
From Pike's official homepage [ida.liu.se] (at the University of Linkoping, Sweden):
Worth downloading [ida.liu.se] and checking out for other reasons [ida.liu.se] than "just" RDF & OWL [w3.org]. Free software, available under LGPL, GPL, and MPL (Mozilla Public License).