I would like to store some Application-Related Metadata for Files, and NTFS Alternate Data Streams (AltDS) would allow me to store this metadata directly on the files rather than in a separate database.
I just don’t feel like this is a good idea. I know that this only works on NTFS, but at least if the user copies/moves the files to a Non-NTFS drive they get a Warning from Windows (yeah, yeah, no one reads warnings, I know)-
But also, storing additional data on a file can become very wasteful, as the AltDS stay even if my Application is uninstalled. It’s like a decade ago when people used “Registry Cleaners” to remove useless entries from the registry after uninstalling a program to make their system run faster (and less stable when the cleaner cleaned too much…).
I just wonder what they can be reasonably used for? Should they be completely left for Microsoft Apps to use? Or is there some sort of common policy what types of apps may use them (apart from malware)?
Edit: Just to clarify what my idea was. I’m in the early stages of writing a small document management system for myself. Because I want to have the freedom to move files around, I want to store metadata on the file so that if I move/rename/modify them, my app still recognizes them. It could either be the entire Metadata or just a GUID that works with a separate database.
To summarize the points given:
Pros:
- Metadata moves with the file, so no need to recognize it through hashing or filename
- Works with all FileTypes, even .txt files where it’s impossible to store any data in the file itself
Cons:
- Only works on NTFS which may not be the default file system in future Windows Versions
- Although it would surprise me if MS doesn’t automatically convert them if they ever get WinFS together
- AltDS remain even if my App is uninstalled
- Privacy concerns
- Fragile
- Most USB Sticks are FAT32. Many private file servers are Linux. Downloading a file from the internet should only transfer the file but not the streams. In short: It’s rather easy to lose them.
It’s hard to say without more information about the kind of data you’re storing. You seem to be aware of some of the concerns involving their use, so I’m not sure how much I can help. Here’s my general thoughts on alternate data streams, though:
First of all, as you’ve noted, AD streams only work on NTFS. If there’s any chance you’ll need to store this metadata on a FAT filesystem, you’ll need some kind of fallback mechanism. Modern PCs will probably have NTFS-formatted internal hard drives, but most USB flash drives you encounter are still FAT-formatted. Keep that in mind if your users will be storing data files on flash drives.
Aside from that, I can’t think of any technological reasons to avoid AD streams, but I’d still be wary of using them. People tend to be nervous about applications that “hide” data from them, regardless of the intent. Consider the Sony rootkit fiasco, and so on. I’m not saying your application is anywhere near as bad as that, but people (especially the less tech-savvy) may not make out the distinction. Still, I will allow that they might have a valid use for your application. The problem of leaving the AD streams behind after uninstallation is still very real, of course. You might want to consider giving people running the uninstaller the option of running a program to search their drive(s) and clean up any remaining streams.
Also, remember the KISS principle. Is the use of AD streams really the simplest way to effectively solve your application’s metadata storage problem? If so, maybe AD streams are a good idea, but, if not, I’d seriously consider taking another approach.