University Chooses Apple RAID for Linux Cluster 68
An anonymous reader writes "A Linux World article describes how Swinburne University chose Apple's Xserve RAID
to add storage to it's Dell linux cluster, as
it was the cheapest solution. Apple was
sceptical about its RAID system working with Linux, but the system was up and running in 15 minutes."
Compression - WOW! wait, I mean HOW? (Score:4, Interesting)
OK, can someone to explain to me that either yes, there is a lot of redundant data that can have crazy-good compression rates, or that no, this quote is wrong...
Re:Compression - WOW! wait, I mean HOW? (Score:4, Informative)
Re:Compression - WOW! wait, I mean HOW? (Score:2)
Re:Compression - WOW! wait, I mean HOW? (Score:3, Funny)
Re:Compression - WOW! wait, I mean HOW? (Score:4, Insightful)
For instance, I might be generating 10GB of logs per day. To save disk space, the streams might be written out with gzip compression (it's write-only, after all), or I might rewrite the formats to conserve space - write the IP addresses in 4 bytes rather than writing out the full ASCII dotted quad, etc. Since it's text and the format is highly redundant, it compresses very well.. I might end up with a 50-500MB log file depending on how things are done. At the end of the day, I could process the statistics and generate report/archive data of several KB that retains all the important data I want to keep from the logs.
~GoRK
Re:Compression - WOW! wait, I mean HOW? (Score:2)
Also, I never said anything about report generation, I said that I can process the logs and retain the important data that I need in a few KB - Most of the good web stats packages out there consolidate large log files into much smaller databases from which they can then run reports and get meaningful data from. Nobody ever said the 'compression' was l
Re:Compression - WOW! wait, I mean HOW? (Score:2)
Re:Compression - WOW! wait, I mean HOW? (Score:1)
Typically, real-time systems trade space for time. The 13TB is probably unprocessed raw data written pretty much as fast as the disks can keep up with it. Then a separate process can read and process the data ending up with a significant reduction. For instance, look at the size of the inputs to seti@home vs. the results sent back. Capice?
Re:Compression - WOW! wait, I mean HOW? (Score:2)
I'm sure they have a reason for needing it though that this article fails to co
Re:Compression - WOW! wait, I mean HOW? (Score:2)
perhaps they have two sets of 13TB disks and fill one while they process the other
Re:Compression - WOW! wait, I mean HOW? (Score:2, Interesting)
The raw data was pretty much noise (quasar output).There were two data streams, from opposite sides of the earth, listening to the same noise source)
The data (after extraction) was very, very small. I can't recall if it would have been on the order of Tb to Kb but it might well have been. We didn't have that much storage, so we had to compute (using custom hardware) in near real time.
With appropriate temporary storage,
Re:Fix spelling "it's - its" (Score:1)
Re:Fix spelling "it's - its" (Score:1)
mmmm....Xserve (Score:3, Funny)
Re:mmmm....Xserve (Score:1)
http://www.urbandictionary.com/define.ph
-joe
Re:mmmm....Xserve (Score:1)
Well, if you'd do this just for yourself, who cares. Then I can see the temptation to just go out and build the bastard. But I can't see institutions go for the "I come with the machine" deal
Re:mmmm....Xserve (Score:1)
Fiberchannel (Score:1)
Re:Fiberchannel (Score:1)
Re:Fiberchannel (Score:3, Informative)
Re:Fiberchannel (Score:3, Informative)
Why they would doubt (Score:2)
Over the years Apple Australia has managed to hire a few people technically competent to think outside the square, but more often, after such people have moved on to bigger challenges, they are left with a team which operates almost entirely on received wisdom.
Xserve is cheap (Score:5, Informative)
Aparently, Apples offering was 2TB storage for 9000 - vs 80,000 for 2TB from Dell/EMC.
In the article he says;The obvious question is whether you can put fibre channel cards into your Windows servers and connect them up too. Apple tells me this is possible The idea being to use the storage for SQL*Server databases and the like.
I'm not surprised this is such a good solution for use with Linux.
Re:Xserve is cheap (Score:2)
I would propose that a price difference of that magnitude would indicate the Dell/EMC product is "doing a bit more".
If the Dell/EMC box is stacked full of 15k RPM SCSI disks and a gig of mirrored cache, for example, then it's going to cost more because it's going to have better performance and reliability.
Re:Xserve is cheap (Score:2)
then you can pay 9,000 or 90,000
Xserve RAID in non-Apple environments (Score:5, Informative)
Cheapest redundant solution (Score:5, Insightful)
the X raid has dual redundant power supplies, redundant fans, dual redundant raid controllers, dual redundant and DEDICATED processors, dual redundant ethernet connection, dual redundant fiber channel outputs. it has separate busses and controllers for each ATI hard disk, and the busses to the disks are high speed. all of the disks are hot swapable self contained pluggin units. and it all sits in 3U. (plus another U for whatever server is receiving the fiber channel). All the software on board is tuned to the task and other than the web admin, the box has no extraneous services.
also the raid is Hardware raid 5,1,0 not software. other than a netapp at 25x the price, there's nothing that comes close.
Re:Cheapest redundant solution (Score:2, Informative)
(Still a good deal for the money
Re:Cheapest redundant solution (Score:3, Informative)
The only "disadvantage" of Apple's product is each individual disk is relatively slow (specs say 7200 RPM vs. 10000 to 15000 RPM for other options). Other than that, Apple really has a killer product (at least on paper...I don't have one
Re:Cheapest redundant solution (Score:4, Insightful)
Re:Cheapest redundant solution (Score:2)
a bold statement from an anonymous post.
Three Questions (Score:2)
1) Would it be hot swappable? (Remember: don't build systems that won't fail, build systems that fail gracefully).
2) What would it cost?
3) Is the fail rate so appreciably different that it matters and so that it would make up for the increased capital cost?
Kewl. Everything to make a slashdot article. (Score:5, Funny)
It has Apple. Check.
It has a low price for server hardware. check.
This article is hearby Slashdot approved.
Re:Kewl. Everything to make a slashdot article. (Score:1)
"hereby"
Um, well "Duh!". (Score:5, Interesting)
Go figure.
It's not rocket science. These devices have been engineered using standards of the industry.
Doh!
Apple's Trojan Horse for I.T. Depts.? (Score:5, Insightful)
Will the XServe RAID become the equivalent Trojan Horse that will slip into corporate data centers and lead to future purchases of XServes?
I hope Apple doesn't ignore this opportunity but instead promotes the fact that the XServe RAID plays well with other systems.
Re:Apple's Trojan Horse for I.T. Depts.? (Score:1)
ide raid (Score:1)
I am aware that the apple product is theoretically a little better due to the fiber chanel over the LVD SCSI that I purchased but I think that for most (not all) people the LVD performance would be good enough.
I personally would recomend these Tornado RAID systems to just about anyone needing a lot of storage for a small pr
I doubt Apple was surprised this worked (Score:5, Informative)
This is the same story they've been telling since xServe RAID was shipping (and probably before that since it was pre-announced very early).
I'm pretty sure that any doubts were from the customers or the Lunuxworld writer and not Apple. They've been trying to sell this for linux boxes. If it was 'Apple' that had doubts, then those engineers need to return to the mothership for some more training.
Carless use of cAsE in abbreviations (Score:2)
"Also, at around 100Mbps read and write to disk, it is faster than our SCSI system which has an I/O of 50Mbps"
Never mind the whole base-2/base-10 "mebibyte" business... why can't people learn that the case of the "b"/"B" is significant!? Clearly he meant megaBytes, not bits.
By the way, Apple advertises [apple.com] the Xserve RAID's throughput in excess of 200MBps.
- Peter
Re:Carless use of cAsE in abbreviations (Score:2)
100 Mbit is only 12.5 MB/sec... pretty crappy for an IDE disk, but they did say per drive.
The xServe RAID has two banks of 7 drives. Each bank has a 2000 Mbit fibre channel connection. So, let's do the math.
2 Gbit / 7 drives is a max bandwidth of around 286 Mbit per drive.
They quoted 100 Mbit sustained per drive.
100 MB/sec x 7 drives would be 700 MB/sec of sustained bandwidth (not to mention that IDE drives don't sustain 100MB/sec.
700 MB/sec is 5.6Gbit/sec,
Re:Apple RAID? (Score:1)
Something is wrong with the price (Score:1)
Here is my back of the envelope calculation:
$45,117 into someone else's pocket
--------
$111,111 Subtotal
-$11,111 Education and volume discount (10%)
--------
$100,000 Total
Where did I make the mistake?
Re:Something is wrong with the price (Score:1, Informative)
Re:Something is wrong with the price (Score:2)
Apple Australia SE told us... (Score:2, Interesting)