Creative COW SIGN IN :: SPONSORS :: ABOUT US :: CONTACT US
BLOGS: My COW BlogMacWorldEditingTechnologyAfter EffectsFinal CutEntertainment

Internal vs. External RAID

So a recent thread in the Creative Cow Final Cut Pro forum about Internal vs. External RAID's got me thinking more about the subject. I'm a firm believer in external RAID's and really don't have any desire to install 3 or 4 drives inside my Mac Pro tower.

Let's think about this. Companies like LaCie, Ciprico, Medéa, CalDigit, Facilis and others spend a lot of time in research and development to produce storage solutions that are not only fast, but reliable. Every board, every drive, every switch, everything about that storage solution has been drawn up, assembled and tested by engineers who know a heckuva lot more than me about the inner workings of computer storage.

The hard drive units themselves are rigorously tested and "beat up" to figure out which manufacturer and model should be installed in a particular RAID unit. Drive reliability is different among manufacturers and even among individual models of the same manufacturer. Company X may have a killer 500GB model but the 750GB model may have issues. RAID companies will discover this issue much faster than I ever will and adjust their products accordingly.

RAID companies that I've dealt with have had very good tech support teams both for generaly questions and in the event of a failure. This is invaluable because when something goes wrong and a deadline is looming, the last thing I want to do is become a hardware engineer and try to figure out exactly where something might be wrong. I have enough trouble just keeping up with all the formats and software we run, I really don't care to become a computer engineer too.

Expansion is so much easier with an external RAID than internal. I mean, what do you do if you have maxed out your internal RAID and now you need another 2TB of storage? I guess you're going to connect an external RAID device? So now you're working with internal AND external media storage, at the same time? That doesn't sound like a very stable solution in my book. Start external, expand external. Keep everything coming down one or two pipes from the outside.

Speed is very limiting when it comes to internal RAID. Four drives striped together are going to be slower than say a 10 drive Ciprico Fibre Array, or maybe two arrays striped together. Heck stripe four of the new CalDigit 4:4:4 arrays together and you're pushing upwards of 900MB/s. You're not going to touch that with and internal RAID and you're certainly not going to stripe and internal AND external RAID together to gain more speed.

Zero protection is had by current internal RAID's as RAID 0 and 1 are the only supported formats right now. With External RAID's you have a multitude of protection options which gives you real control over speed vs. protection. Granted, right now I run an external SATA Array in RAID 0, but I also run another external backup device. But that will change in the next few months and we migrate potentially back to Fibre Channel.

I figured I'd ask an engineer I know about this debate and he said external is always the preferred way to go when working with high volume media storage. It's generally faster, more stable and a much more proven technology.

There you go, my reasoning for working with and recommending external RAID storage. You're free to do what you want, but this is where I stand on all this.


Posted by: walter biscardi on Mar 13, 2007 at 8:24:22 pm Comments (7) raid, mac os, editing, hdv, storage, hd, dv

Comments:
Fun with Peter Wiggins
by walter biscardi on Apr 13, 2007

Well, surfing around the net the other day I found Peter Wiggins' blog and funny how the same thread I referred to above, also got him to post his thoughts on the subject of Internal vs. External RAID's. It appears that I got under his skin a little. An excerpt:

Now, what really got my goat was the fact that a well known forum host was saying that he didn't recommend internal RAIDs.

Now Peter is a fantastic guy and really knows his stuff and I just wanted to say 'Peter, I've got your goat and I've taken really good care of it, but I think he wants to go home. So meet me in Vegas and I'll hand him back to you.'

That's the fun part about our business, there are so many varied opinions and if we all agreed to everything all the time, how boring would that be? Here's Peter's entry if you want to read his easy to follow instructions on installing an internal RAID.

http://peterwiggins.com/content/view/12/33/

I meant PCI-Express
by josephpotts on Mar 23, 2007
Sorry I stated PCI-X, but I meant PCI-Express in the entry above.
PCI-X interface
by josephpotts on Mar 23, 2007
What is your sense of using a PCI-X for interfacing to the external SATA array?  Also, I was thinking of multiple 750 gig internal hard drives just for storage capacity and using the external SATA  drives in a RAID for my HD video work (Mac pro  dual quad, if it ever comes out).  Is there any thing wrong with that thinking
Interesting on the PC
by walter biscardi on Mar 22, 2007

Interesting that you can put the 8 drives inside there.  But I'm still an external enclosure guy.  I love the flexibility to be able to move storage in the case of a machine failure.   250MB/s is a good speed, but we can get faster with fibre and multiple SATA units striped together.

But a great point to know you can put so many units together inside a PC enclosure.  For some applications, I can see where that would work nicely.

As long as you're stuck with
by Barend Onneweer on Mar 22, 2007

As long as you're stuck with the Mac Pro enclosure, I agree. I run a Windows workstation in a Thermaltake Stacker case with 8 drives in RAID 5, on an Areca 1120 PCI-X hardware RAID adapter. Easily runs over 250 MB/s throughout 85% of the drive capacity, and no heat problems.  The most cost-effective high-performance RAID solution I could come up with 18 months ago. And since it's hardware RAID there's hardly any CPU load. 

Absolutely!
by walter biscardi on Mar 14, 2007

It's pretty much a no-brainer if multi-terabyte capacity is required.

Couldn't agree more.   

Internal vs. External RAID
by Lyn Norstad on Mar 14, 2007

The main problem with internal Raid arrays is, from our standpoint, resource allocation.  In order to have an efficient Raid 5 (for example) setup, you really need to have at least 5 drives in the array.  That's too much of a load for internal resources (space, heat, power) in most cases.

We much prefer external SATA arrays interfaced to the computer thru dual-channel U320 SCSI (or 4 Gb Fibre).  A little more expensive than straight SATA, but so much more versatile and more reliable.  One of our HD systems, for example, regularly uses 16 SATA drives (RAID5) to provide dual stream, uncompressed 1080i along with hot swap, hot spare(s), and full data security (no backup needed).

It's pretty much a no-brainer if multi-terabyte capacity is required.

Login to Comment
walter biscardi

walter biscardi


Professional Video Editor, Producer, Director since 1990.

Credits include multiple Emmys, Tellys, Aurora and CableAce Awards.

Owner / Operator of Biscardi Creative Media, a full service video and film production company with about 65% of our work in HDTV. The show you know us best for is "Good Eats" on the Food Network. I developed the HD Post workflow and we also create all the animations for the series.

Favorite pastime is cooking with pizza on the grill one of my specialties. Each Christmas Eve we serve the Feast of the Seven Fishes, a traditional Italian seafood meal with approx. 30 items on the menu.

If I wasn't in video production I would either own a restaurant or a movie theater.

 


Blog FeedRSS


Tags:

apple (72)
final cut pro (56)
editing (43)
hd (24)
entertainment (19)
bluray (16)
hd dvd (14)
dvd (13)
technology (12)
adobe (11)
family (11)
iphone (10)
television (9)
after effects (9)
business (8)
documentaries (8)
indie film (8)
nab (6)
mac os (5)
storage (5)
monitors (4)
color (4)
monitor (4)
creative cow (3)
avid (3)
politics (3)
premiere pro (3)
animation (3)
macworld (3)
flanders scientific (3)
lcd (3)
ipod (3)
apple color (3)
fsi (2)
pets (2)
color enhancement (2)
compression (2)
san (2)
maxx digital (2)
color grading (2)
web (2)
apple tv (2)
health care (2)
gaming (2)
environment (2)
sony (2)
sports (2)
movies (2)
hdv (1)
raid (1)
dv (1)
canon (1)
aja (1)
travel (1)
youtube (1)
platform wars (1)
panasonic (1)
colorgrading (1)
cd printers (1)
cd burners (1)
photoshop (1)
music (1)
podcasting (1)
future the (1)
commercials (1)
websites (1)
itunes (1)
videospace (1)
episode pro (1)
os (1)
snow leopard (1)
pro (1)
color enhancment (1)
final cut studio (1)
18 grey (1)
pixar (1)
training (1)
cut (1)
final (1)
led (1)
creative cow master series (1)
mac pro (1)
fibreshare (1)
cable tv (1)
catdv (1)
customer service (1)
biscardi creative media (1)
nsf (1)
final share san (1)
leasing (1)
loan (1)
telestream (1)
internet (1)
episode (1)
compressor (1)
financing (1)
bailout (1)
broadcast (1)
emmy (1)
biscardi creative (1)
broadcast monitors (1)
lcd monitors (1)
converter (1)
encore (1)
mpeg2 (1)


Archives:

November 2009 (6)
August 2009 (3)
July 2009 (5)
June 2009 (4)
May 2009 (2)
April 2009 (3)
March 2009 (6)
February 2009 (2)
January 2009 (3)
December 2008 (1)
November 2008 (3)
October 2008 (9)
September 2008 (1)
August 2008 (2)
July 2008 (6)
May 2008 (5)
April 2008 (2)
March 2008 (5)
February 2008 (8)
January 2008 (15)
December 2007 (3)
November 2007 (1)
October 2007 (2)
September 2007 (5)
August 2007 (6)
July 2007 (4)
June 2007 (8)
May 2007 (7)
April 2007 (4)
March 2007 (7)
February 2007 (3)


FORUMSTUTORIALSMAGAZINETRAININGVIDEOS - REELSPODCASTSEVENTSSERVICESNEWSLETTERNEWSBLOGS

© CreativeCOW.net All rights are reserved.

[Top]