Apple Looking at ZFS For Mac OS X 261
Udo Schmitz writes "Apples Filesystem Development Manager, Chris Emura, is looking into porting Sun Microsystems' file system ZFS to OS X. At least this is what Sun's Eric Kustarz states on the ZFS mailing list. Is this a glimpse of hope for all those of us who think HFS+ isn't up to par for a 21st century OS? Next thing you know and they'll rewrite the Finder ..."
Comparison of Filesystems. (Score:5, Informative)
The main advantage for HFS+ users (I mean who's really going to need a 16,000,000 Gigabyte file) would be the introduction of journalling beyond metadata (and even this is unlikely to be useful to most people).
Re:Comparison of Filesystems. (Score:5, Interesting)
Imagine being able to take really fast working copies of whatever you're doing and be able to simple use the old versions by cd'ing to the old clone.
That's certainly what I would use ZFS for. The rest of the stuff, pooling and mirroring and stuff is less interesting in my laptop. :-)
Re:Comparison of Filesystems. (Score:2, Interesting)
Re:Comparison of Filesystems. (Score:2)
Re:Comparison of Filesystems. (Score:2, Interesting)
Re:Comparison of Filesystems. (Score:2)
Re:Comparison of Filesystems. (Score:3, Interesting)
I would love for the FS to do snapshot saves with incrementals and checkpoints and rollback, instead of having each application do it. This provides unlimited undos potential with actual stored versions... a true 'history' of the file, availab
Think you'll get it? (Score:2)
FreeBSD's UFS supports snapshotting, but Apple didn't port that feature over. I'm not sure why they'd fully support ZFS when they're not fully supporting the other filesystem they already have.
I've made a few "what about UFS?" comments in this story, but I hope I don't come across as some weird filesystem fanboy. It's just that I can't figure out why this announcement is so exciting. ZFS is cool, sure, but I see it as an incremental imp
Re:Think you'll get it? (Score:3, Interesting)
Thanks to this, a lot of interesting stuff becomes possible, such as the fast file system creation which is demonstrated in this very cool demo [opensolaris.org].
If you don't consider ZFS a qua
Re:Think you'll get it? (Score:4, Interesting)
I can tell you grew up in the UNIX world. Everything I read about ZFS reminds me very much of VMS. Twenty years ago. If you read the UNIX Hater Handbook (published 12 years ago), then you will find a very nice rant about how the UNIX concept of partitions is a huge step back from what VMS offered. Now, over a decade later, it seems someone has listened.
Re:Think you'll get it? (Score:5, Informative)
And yes, I know that Windows NT is sort of descended from VMS. But I've not seen many of the concepts make it up to userland cleanly implemented.
And I'm also aware that VMS is still around. It may not be on life-support yet, but it's clearly in the nursing home already.
Re:Think you'll get it? (Score:3, Insightful)
I think part of what makes this story so interesting is that despite the past few years' developments, most of us still expect Apple to act as it used to with regard to adopting new technology. In
Re:Think you'll get it? (Score:4, Funny)
I guess it worked [apple.com].
ZFS on a {Power|Mac}Book{| Pro} (Score:3, Insightful)
Quite to the contrary! The most unreliable element in your laptop is your drive. It will fail at some point, have no doubts about it. ZFS will detect silent failures through its checksumming.
ZFS also makes it possible to do super-fast backups to external disk. Combine that with snapshots and you have the kind of data security enterprises pay a whole lot of money for. Here's how it works:
Re:Comparison of Filesystems. (Score:2)
Re:Comparison of Filesystems. (Score:2)
If ZFS is included, it may be a sign that Apple is considering a bigger plunge into the enterprise markets because that seems to be where ZFS can shine. They are big in the storage markets with XServe RAID enclosures, both drive capacities and even orders seem to be going up.
Re:Comparison of Filesystems. (Score:2)
ZFS would make MacOS X a more attractive server platform, especially with kliky intuitive admin tools; cue SOHO XServe RAID tower system for mass file storage with redundancy, reliability and expandability with wide geek ap
640K is enough (Score:2)
Wasn't 640K meant to be enough? That is to say, just because you can't imagine the need based on today's problems doesn't mean someone isn't going to find a need. I wonder how big a big database can get?
Re:Comparison of Filesystems. (Score:3, Funny)
I mean who's really going to need a 16,000,000 Gigabyte file
Actually, I keep an archive of all Slashdot dupes...
beyond RAID in data integrity, self-healing (Score:3, Informative)
Re:Comparison of Filesystems. (Score:5, Informative)
Comment removed (Score:5, Interesting)
Re:Comparison of Filesystems. (Score:2)
I'm interested in you claim that an OS X engineer said not to fill your disk beyond 60-70% for the system to work best. Can you provide any backup links for that?
Re:Comparison of Filesystems. (Score:2, Informative)
Most modern filesystems do some amount of 'defrag' automatically over time. Windows XP w/ NTFS does this, I would bet HFS+ is designed to do this. Of course, if there isn't a lot of free space to play with, the automatic 'opportunistic' defrag has a lot less chance of moving a large file to a bit of contiguous free space. If you can manage it, don't fill your drives to the brim. It will hamper performance, and it will
Re:Comparison of Filesystems. (Score:4, Informative)
That said, most desktop users will not notice a big difference between a fragmented, quick-defragment (defrag files, but don't consolidate free space) and full defragmented disk. A typical modern HDD has a 35-40MB/s minimum transfer rate. DV, probably the most resource intensive any normal person bothers with has a measly 25Mb/s = 3,2MB/s. Unless you're suffering from really horrible fragmentation, that should be no problem. Same goes for analog capture with hardware/on-the-fly compression. Yes, there are fringe areas like raw analog video or scientific data but audio capture isn't part of it anymore. And if you're that specific, using a separate tool isn't that big a deal. Servers OTOH might be something, but I imagine most of that is handled by other parts than the OS disk I/O.
Comment removed (Score:4, Informative)
Re:Comparison of Filesystems. (Score:2)
Re:Comparison of Filesystems. (Score:2)
HFS plus fragmentation [kernelthread.com]
Also XFS doesn't use journalling, it is a transactional file system that ensures on disk structures are always consistent, no need for a journal.
Re:Comparison of Filesystems. (Score:2)
Re:Comparison of Filesystems. (Score:2, Interesting)
Great if it's true (Score:2)
Re:Great if it's true (Score:2)
Re:Great if it's true (Score:2)
That's one of the differences between being a company and being an open source project. For a company, it does matter; supporting every filesystem under the sun is a detriment, not a benefit, because there are real incremental costs for each additional one you add.
Re:Great if it's true (Score:2)
Re:Great if it's true (Score:2)
Re:Great if it's true (Score:2)
Re:Great if it's true (Score:3, Insightful)
Supporting lots of filesystems is hard. Mistakes are difficult to track down and harshly punished, licenses and API's generally aren't amenable to straight ports, and it's a lot of work for what's typically a fairly small ROI. Also, porting one filesystem doesn't generally make porting another significantly easier. You might as well ask:
"But why just a skyscraper? Why not add a warehouse or a subterranean bu
Re:Great if it's true (Score:2, Insightful)
Also imagine Disk Utility having a popup to format a Disk that made users choose between:
EXT3
FAT
HFS+
HFS+ (case sensitive)
JFS
UFS
XFS
ZFS
Then try to explain to Grandma which is the correct one for them to choose in a litle
Slashdot is Getting Better Again (Score:4, Interesting)
Beats the heck out of story about a blog posting that's just a regurgitation of an MSNBC article that doesn't know what the frack it's talking about.
Re:Slashdot is Getting Better Again (Score:2)
"Is this a glimpse of hope for all those of us who think HFS+ isn't up to par for a 21st century OS?"
Who are them? I really want to meet with them as a guy using disk filesystems since 1984. 21th century OS?!
Please editors, apple.slashdot.org has started very slow but it is very widely read by Mac users now. You don't need that "thing" you know? I don't think it needs more explanation than that.
Comment removed (Score:5, Insightful)
Re:This is meaningless (Score:5, Informative)
Here is the ars technica low-down on what ZFS does differently and why that's such a good thing.
arstechnica.com/news.ars/post/20051117-5595.html [arstechnica.com]
Re: (Score:2)
Re:This is meaningless (Score:2)
It also has a flexible & extensible on-disk format so that additional attributes/metadata can be added to files in newer versions of the filesystem without forcing existing pools to be reformatted.
Re: (Score:2)
Re:This is meaningless (Score:2)
I see spotlight as apple's attempt to get away from any one filesystem, it d
Re:This is meaningless (Score:2)
What about the various BSDs?
Re:This is meaningless (Score:2)
Indeed. I would be absolutely amazed to find that there are more Solaris installations (which I've never actually seen in the wild) than FreeBSD (which I've seen at almost every Unix-based shop I've dealt with).
I don't have any hard numbers to back that up, but experience makes me pretty skeptical of that claim.
Re:This is meaningless (Score:2)
"drwxr-xr-x 4 root wheel 136 Aug 23 2005 webdav.fs"
"drwxr-xr-x 3 root wheel 102 Aug 23 2005 smbfs.fs"
ext2fs as an option (Score:2)
Re:ext2fs as an option (Score:2)
Why can't Apple include ext2 support standard?! It boggles my mind. There doesn't exist, today, a Unixy filesystem that both OS X and Linux can read and write to reliably.
Dlugar
Re:Tiger Filesystems (10.4.6) (Score:3, Funny)
For the record, if I had mod points I would have modded GP up as "Informative"
Last login: Thu Apr 20 18:20:18 on ttyp1
Welcome to Darwin!
[athena:~] aibrahim% ls -l
total 8
drwxr-xr-x 9 root wheel 306 Apr 4 11:14 AppleShare
drwxr-xr-x 7 root wheel 238 Apr 2 2005 URLMount
lrwxr-xr-x 1 root wheel 49 Nov
What Apple Is Looking For (Score:5, Interesting)
Re:one word (Score:2, Interesting)
Who stil uses HFS+ anyway? (Score:2)
And from the view point of a average user, he wont see a difference regardless of what FS hes using..
Re:Who stil uses HFS+ anyway? (Score:2)
Re:Who stil uses HFS+ anyway? (Score:2)
If you are in Stanford and your particular program setup runs happily under UFS (or it needs it) it is not "we" or "us", "we" should be 90%+ of userbase if you want to generalize anything.
Oh
Intel Macs good oppurtunity to make a clean break (Score:3, Informative)
So now with the Intel Macs and no need for Mac OS 9 support, Apple can tell all their developers that all Universal apps must be able to run on UFS. That way should Apple decide to adopt ZFS it should be a painless transition. Holding on to HFS + with the Intel Macs for this long will hamper any transition into a future filesystem. This will prepare Adobe and Microsoft to write their new Universal versions to be able to accept any type of filesystem and not rely on the resource fork of HFS
That's my 2 cents.
Re:Intel Macs good oppurtunity to make a clean bre (Score:2, Insightful)
Why stop at ZFS? (Score:2, Insightful)
Re:Why stop at ZFS? (Score:2)
I have heard all kinds of speculation about that since Ave Tevanian announced his departure. The Mach microkernel was his project.
Re:Why stop at ZFS? (Score:2)
Re:Why stop at ZFS? (Score:2)
This isn't saying the microkernals are a bad choice. QNX and L5 both have good microkernals. Mach just has a lot of unneeded baggage.
Re:Why stop at ZFS? (Score:2)
that's nice. now fix network file systems. (Score:5, Insightful)
I've looked at AFP, but that essentially mounts the remote system as if it were an external drive, and assigns everything to the logged in user, so ownership, permissions, etc., are all really screwy. Plus that gets even worse if you use fast user switching -- now two people are independently trying to mount the same network drive, each claiming to own it outright. And it doesn't look as seamless as, say, simply going to
SMB isn't much better.
There's always AFS, but that's so bloody complicated that I'd take a lot of convincing before I seriously considered it.
This isn't even to mention the problems that most apps have in working in a networked environment -- applications simply aren't designed for, say, networked home directories, and *especially* aren't designed to be running simultaneously on multiple systems. So if I've got Mail.app running in the den and I log in upstairs to check mail just before I go to bed, things could get messed up.
I'm not sure there's even been a new network file system since the mid 90's, has there? Certainly, nothing with broad support that fixes some of these issues? All I want is UNIX filesystem features -- simple locking (I guess), owners, regular permissions. Doesn't even need to do ACLs. Transparently mounted so it looks like it's part of the local filesystem. And at least reasonably tolerant of network glitches, so a momentary drop at the server (or whatever else happens to screw NFS connections to the wall) doesn't put all apps which have even heard of the mount point into an uninterruptible kernel-level deep-freeze (what's the point of kill -9, dammit?). Is that so difficult?
Re:that's nice. now fix network file systems. (Score:2)
If you are a dev, you could see on the Darwin-Dev mailing list ( http://lists.apple.com/ [apple.com] ), or if not send feedback to Apple: http://www.apple.com/macosx/feedback/ [apple.com]
IAAWTP (Score:2)
AFAICT, the "best" networking solution on MacOS X is to stick to ye olde AppleShare (eg Win2K Server running SFM). However that's too cumbersome for most home networks.
Re:that's nice. now fix network file systems. (Score:2)
Things like this can be fixed by setting applications up properly. In this situation, I would be using IMAP, not NFS.
Re:that's nice. now fix network file systems. (Score:2)
Things like this can be fixed by setting applications up properly. In this situation, I would be using IMAP, not NFS.
I do use IMAP, and Mail.app talks to it just fine. The problem arises when I'm using Mail.app to read email from two boxes at once, both operating out of a network-based home folder. The app has some cache/index files that don't play well in a sharing environme
Re:that's nice. now fix network file systems. (Score:2)
Right now, I'm using a Linux server with three Macs (two Tiger, one Panther), and everything is over NFS. Most of the time, it works fine, but if there's a weird hiccup, then the Mac will freeze solid and has to be hard power-cycled.
This issue has to do with how you're mounting the NFS share. In particular, it sounds like you're using the hard mount option when what you want is soft. If hard is specified and there's an issue the client will stop and wait for the nfs server to be available again befor
Re:that's nice. now fix network file systems. (Score:2)
Soft on the other hand will time out and display an error if the NFS server an issue occurs.
Well that's what I get for posting before my morning coffee. That bad attempt at Yoda-speak should read: "Soft on the other hand will time out and display an error if an issue with the NFS server occurs."
Reiser4 would be a better choice (Score:2)
Re:Reiser4 would be a better choice (Score:4, Informative)
Most excellent! (Score:3, Insightful)
HFS is big endian (Score:4, Insightful)
Even so, all of the other features of ZFS are worth much more than this. If Apple is anything more than a consumer widget company now, ZFS should definitely be under consideration.
ZFS is far from "just another filesystem," and comparing it to existing filesystems indicates a lack of understanding. Take a look at this presentation [opensolaris.org] for more information.
Re:HFS is big endian (Score:5, Informative)
Currently on intel macs, all disk IO has to be byte swapped, degrading performance. ZFS on the other hand will store data in the machines native format.
While the non-native byte ordering does slow performance this only applies to metadata and not the contents of the files.
rewriting the Finder (Score:4, Informative)
Re:rewriting the Finder (Score:2)
What the heck does it find? At least on Windows "Windows Explorer" gives you some hint as to what it does. Call it "Network Surfer", "Network Browser", whatever.
Yes, the Finder does have a "Find" menu choice, but so does most every app.
Re:rewriting the Finder (Score:2)
Erm, network browsing is just a side feature of Finder. Its real job is file browsing. As much as it needs to be rewritten (I was actually complaining about this [mspong.com] just last night), the name is fine. It's used, among other things, for "finding" files.
Re:rewriting the Finder (Score:2)
The days of the desktop metaphor were brought to an end with Mac OS X. People deserve better from the company that was famous for and go
Apple should just buy SUN (Score:5, Interesting)
Mac OS X is a great consumer OS, but performance at the high end is sub-par. For servers, Solaris is fast and scalable, has nifty features like ZFS and DTrace, but the UI is pretty crude. Imagine a merger of these. Looking at their market [yahoo.com] caps [yahoo.com], Apple can afford it.
Re:Apple should just buy SUN (Score:5, Interesting)
I like your comment. And the reason why I like it so much has to do with my (past) experience on a University system. Universities developed servers and file sharing with Macs using Sun's servers because Apple really didn't have a server. I mean you could put a Mac (usually an older one) on a network and tell it to share files with everyone but it lacked lots of stuff you would expect to have in a server and it tended to be pretty slow.
I would argue that it was the University exposure that lead Apple to offer Ethernet on Macs. Appletalk was great and people hooked themselves up very quickly with Appletalk (you could buy cabling at your local Radio Shack or use almost any twisted-pair cabling, including electrical cables) but Ethernet was a lot faster and more reliable. I'll bet the folks who developed 10 Base-T Ethernet were thinking Appletalk when they came up with the design for the connector and the twisted pair.
But I digress...
I did a fair amount of work with a hard Science department and they all had Suns as servers. They were strictly Sun Unix for the geeks and they developed systems and applications on that model. But for those who actually had to function in an office environment, the Macs were standard. They used Microsoft's Office for memos, reports and spreadsheets and TeX for document publishing. Everything you did worked.
Frankly, I think this legacy is part of the reason why Apple got fascinated with Unix again (that, and Jobs' NeXt company). It would be a good marriage. Apple's X-Serve RAIDs with Sun. Sweet!
unfounded opinions (Score:3, Funny)
Re: (Score:2)
Re:HFS+ vs. UFS vs. ZFS (Score:2)
It never occurred to me to use a case-sensitive HFS+. What's the advantage of that?
Re:HFS+ vs. UFS vs. ZFS (Score:2)
Re:HFS+ vs. UFS vs. ZFS (Score:4, Informative)
Re:HFS+ vs. UFS vs. ZFS (Score:2)
UNIX File System is not supported
Windows Media Player for Mac OS X does not support the UNIX File System (UFS). Install the Player on a Mac OS Extended (HFS+) volume only. HFS+ is the default file system format for Mac OS X.
jeez.
Re:HFS+ vs. UFS vs. ZFS (Score:3, Informative)
It helps to have knowledgeable moderators, but posts still have to be moderated to be useful for a general audience. In this case, the post in question doesn't tell you much if you don't happen to be very familiar with different file systems for OSX and the compatibility of OSX software with those file systems.
Is the grandparent post flamebait? maybe not. Without minus_273's though, its probably not useful enought to be modded up either. Whether the moderation system is right or wrong, isn't the point here
Re:dunno bout m$... (Score:3, Insightful)
Demonstrably not true. I've thought that way since I learned to read. In fact, I was confused the first time I dealt with an MS-DOS machine (before I ever heard of Unix), because the instructions showed commands in upper case and I thought I had to type them that way. Everything I do is based on identifying and classifying differences - "F" and "f" are patently not the same thing to me.
People, at least people familiar with
Re:HFS+ vs. UFS vs. ZFS (Score:5, Informative)
It's the same deal with the problem with Classic. All 3 items you link to are for OSX 10.0 and have been fixed since then. The number of UFS problems now is minute compared to then.
Re:HFS+ vs. UFS vs. ZFS (Score:2)
I stopped paying attention to UFS around 10,1, but at that point there was no support for the Mac Resource Fork, which was still widely being used.
Re:HFS+ vs. UFS vs. ZFS (Score:2)
(and as others in this thread have noticed, it doesn't play well with legacy apps)
Re:HFS+ vs. UFS vs. ZFS (Score:2)
"UFS is case-sensitive"
Why is this a problem? I've been living with case-sensitive systems for years. Never been a problem before.
"AirPort and UFS"
They bug you mentioned has been fixed, lo these many updates ago. Only affected 10.0.
"Customizing Hard Disk Volume Name"
OK, name it correctly when you format it. And live with the prepended "/". No big deal.
"Mac OS X Classic Environment and UFS"
People still use Classic? I haven't used the Classic environment since 10.0 shipped.
"Mac OS 9 and UFS"
People still
Re:HFS+ vs. UFS vs. ZFS (Score:2)
Thanks for that! Super-helpful.
Nothing like being told you don't need to do something you're doing.
Re:YAY! (Score:2)
Re:YAY! (Score:2)
Re:BSD leads, Apple follows once again (Score:2, Insightful)
BeFS (Score:2)
Re:What ever happened to BeFS? (Score:3, Informative)