I have some openings Tuesday and Wednesday – 10th , 11th – for folks who’d like to engage.

Let me know in the comments or at my email.

Thanks!

Related posts:

1. StorageMojo at NAB next week Consumerization is a major driving force in 21st century IT....
2. StorageMojo@SNW next week Finally, SNW is back in Phoenix, an easy 2 hour...
3. StorageMojo at SNW Orlando next week StorageMojo’s global HQ is packing up for Orlando on Monday...

Related posts brought to you by Yet Another Related Posts Plugin.

1. StorageMojo at NAB next week Consumerization is a major driving force in 21st century IT....
2. StorageMojo@SNW next week Finally, SNW is back in Phoenix, an easy 2 hour...
3. StorageMojo at SNW Orlando next week StorageMojo’s global HQ is packing up for Orlando on Monday...

It gushes money
Gartner’s business model is genius. They gather information from vendors and users – for large fees from both – and then sell that information back to them for even more money. Bliss.

They own a toll booth on the user/vendor information highway. And collect $1.3 billion a year from the traffic – over $300,000 per employee. Drool.

But the best is the Magic Quadrant, Gartner’s money-spinning qualitative graphic. You’ve seen it, but here’s a blank version.

The “magic” is how it gets tech execs leaping, like spawning salmon, for the upper right corner.

The little engine that couldn’t
Everyone toes Gartner’s line. Until now.

Beth Pariseau posted on ZL Technologies’ suit against Gartner . ZLT hopes to force Gartner to provide:

• Fair Disclosure on Conflicts of Interest – Gartner generates its revenues from payments made by the same vendors whose products it evaluates. Similar to the new rules now being imposed on financial ratings agencies on Wall Street, Gartner should be required to disclose the revenues received from the vendors it ranks.
• Fair Disclosure on Evaluation Scores – The tech industry would benefit if Gartner were required to disclose more data in its evaluation process and disclose component scores so vendors know exactly where they are lacking and by how much and take corrective action. Currently, there is zero disclosure, which can lead to arbitrary placement, with no recourse and no basis for appeal.
• Better Oversight – Gartner currently has an employee act as ombudsman to handle disagreements. The conflict of interest is self-evident in the way ZL’s concerns were summarily dismissed with little supporting evidence. There is a crying need to establish an impartial ombudsman similar to those found in public media, in order to ensure purchasers that they are receiving impartial analysis.

Sour grapes?
In its court filings ZLT talks about the harm it suffers caused by customer reliance on the MQ. I’m not surprised.

As Geoffrey Moore noted in Inside the Tornado IT managers are herd animals. They know there is safety in numbers – in keeping their jobs and getting problems solved – so they like to stick together.

The power of the MQ is that it captures this mentality and gives it a graphic form that comforts even the most technophobic CFO/CEO in a few seconds. IT may not have the foggiest notion about the firm’s 5 year requirements or what implementation will entail, but by going with the big guy they have an alibi and an escape plan all in one.

MQ criteria
Gartner’s lumps all the MQ verbiage under 2 headings:

• Ability to execute
• Completeness of vision

Ability to execute
Ability to execute favors the large. If you’ve got 5,000 engineers and free cash flow you can, eventually, execute anything. Never mind that a team with 10 smart engineers and a clear vision will move faster and smarter to solve a particular problem: tiny CDC built the first supercomputer, not IBM.

Many of the criteria explicitly favor size: global presence in large markets; “viability;” market share; marketing and sales to drive acceptance; and more. You’re a smaller company? Tough. It’s Gartner’s quadrant and you may not live in it.

Completeness of vision
The large company bias here is the way markets are defined. For example, the mid to high-end NAS MQ excludes vendors whose focus, today, is not “primary file systems storage, instead of storage that narrowly targets backup or archive data.”

But the available research finds that most enterprise files are created and accessed only a few times. What then is the difference between “primary” and “archive” storage? Shouldn’t Gartner raise their enterprise customer’s awareness of this and other file storage issues?

Gartner analysts read the research. Why doesn’t the MQ reflect the best information in major use cases, instead of reinforcing popular prejudice? Doesn’t Moore’s Law steadily move the bar upward for what “narrowly” focused systems can do?

Mid to high-end NAS that includes both scale-up and scale-out – as Gartner’s market definition does – is lumping 2 very different markets together and blurring the distinctions. Rather than accepting vendor market definitions, Gartner analysts should be in the forefront of defining new market segments.

For $100,000+ per year a CIO should expect no less.

The StorageMojo take
The Magic Quadrant has the analytical rigor of a beauty contest. Implicit and explicit assumptions about customers, markets, technologies, use cases and suppliers obscures more than it reveals. The MQ seeks to rank vendors not only by what their products do, but by what Gartner presumes an enterprise customer should want. They presume too much.

Marketers often disagree about what constitutes a “product:” is it the widget itself; the widget + services; or the widget + services + ?? In truth, customer perception of what constitutes a product changes with time and experience. But Gartner is stuck: if someone has a better widget – as ZLT says it does – there is no way that the MQ will tell you that.

Enterprise IT staffs abhor change, so Gartner could argue they are meeting customer needs by rigging the MQ to favor incumbents. But the current crisis and the need for greater efficiency and cost-effectiveness means decision makers need better data and informed opinion.

If ZLT, for example, can search archived emails 1,000x faster than Symantec – as they claim – then Gartner should disclose that for the customers for whom performance is important. Get feedback from actual customers – what Gartner does today – about ZLT and pass it on. Don’t just ding them because they’re small.

Customers aren’t idiots; they can see that a company isn’t very big. What they don’t know is how well their products work.

Gartner needs to start earning that $1.3 billion, not just collecting it. If the FTC can require lowly bloggers to report vendor freebies and payments, perhaps the day isn’t far off when mighty IT consulting shops will have to do likewise. Kudos to ZLT for noting the emperor’s scanty attire.

Courteous comments welcome, of course.

No related posts.

Related posts brought to you by Yet Another Related Posts Plugin.

Ding, dong.
PC file system progress took a giant step back this week with the news on MacOSforge that Apple’s ZFS project has been discontinued.

ZFS Project Shutdown 2009-10-23
The ZFS project has been discontinued. The mailing list and repository will also be removed shortly.

Apple announced in June ‘08 that Snow Leopard server would support ZFS. But things came apart early this year.

What happened?
Jeff Bonwick, ZFS architect, posted Saturday on an earlier quoted comment:

> Apple can currently just take the ZFS CDDL code and incorporate it
> (like they did with DTrace), but it may be that they wanted a “private
> license” from Sun (with appropriate technical support and
> indemnification), and the two entities couldn’t come to mutually
> agreeable terms.

I cannot disclose details, but that is the essence of it.

Jeff

Indemnification?
Sun is being sued by NetApp claiming that ZFS infringes on NetApp patents. If NetApp won, Apple would find itself in a tough position unless Sun shouldered the financial damage. That’s indemnification.

IMHO Sun has a good case that NetApp’s patents will be invalidated by prior art. But with all their other problems and the Oracle purchase it was a headache they, Oracle and Apple didn’t need.

Where does Apple go from here?
Apple has hired some smart file system engineers and wants to hire more to work on “state-of-the-art file system technologies for Mac OS X.”

I’m not convinced: it sounds like standard HR boilerplate and a snare for the unwary. But hey! it could happen.

But writing new file systems isn’t easy. It takes 5-7 years for a new file system to achieve the maturity needed to support large-scale deployment. Even replacing QuickTime is non-trivial.

So if Apple is starting from scratch we have a long wait for real innovation to appear. Like Mac OS XII.

What about Microsoft?
Meanwhile Redmond’s file system gurus are well aware of NTFS issues. They’re making stepwise enhancements.

But as the NTFS and HFS+ architectures age and the pace of storage innovation increases the gap between what is and what could be grows. It’s like putting a 1001 hp Bugatti engine in a Model T: the power is there but you can’t use it.

The StorageMojo take
I already hate software patents – but that’s another post. As long as law allows companies will try to enforce them.

Why didn’t Apple cut a deal with NetApp directly? Probably for the same reason Sun didn’t: money. Apple has a lot more of it than Sun, but Steve is a tightwad, especially when it comes to storage.

NetApp could have raised their visibility in the consumer market by cutting a deal with Apple, but NetApp’s management isn’t thinking strategically about the low-end of the market, as the rapidity of StoreVault’s entrance and exit demonstrated. True, they have bigger issues, but multi-tasking is supposed to be a corporate strength.

Consumers are generating masses of video and photos at an accelerating pace – and they’ll need reliable, available and dirt-easy storage. Lots of it.

Let EMC supply it!

Until the Next New Thing in file systems rolls out of Cupertino, Redmond or, maybe, Redwood City, consumers will stuck with too many BSODs, missing or corrupted files and app crashes. Let’s hope we don’t have to wait too many more years.

Comments welcome, of course. An earlier version of this was posted on Storage Bits. Can you spot the dozen or so differences?

And there is a Google code page for MacZFS for you diehards out there.

Related posts:

1. Why did Apple drop ZFS? With the release of Snow Leopard it is now official:...
2. Btrfs vs ZFS – OMG! Am @ Interop today – a nice, relaxing 250 mile...
3. Stupid storage failures Valiant but doomed The ZFS discussion thread had an interesting...

Related posts brought to you by Yet Another Related Posts Plugin.

1. Why did Apple drop ZFS? With the release of Snow Leopard it is now official:...
2. Btrfs vs ZFS – OMG! Am @ Interop today – a nice, relaxing 250 mile...
3. Stupid storage failures Valiant but doomed The ZFS discussion thread had an interesting...

Spent 3 days at fall ‘09 SNW. Given the economy my expectations were low.

The good news: it was active. The better news: the pace of innovation across storage is accelerating, despite the economy and the drop in VC funding.

Make that perhaps because of the drop in VC funding. Veterans of prior startups have self-funding and the chops to prototype and market-test without VC “help.”

Fewer vendor staff – more customer interaction
Vendors brought fewer people – a good thing. Too often SNW booths are reunions of industry veterans leaving customers on the outside looking in.

They breakout sessions I saw were near full to SRO. Much content on SSD’s, cloud storage de-duplication, backup/archive and more.

The biggest disappointment was the Cisco UCS presentation. The Cisco NDAs must be dynamite because the public information isn’t.

New companies and products
Dataram was there with their new flash FC caching appliance, the XcelaSAN (pdf). They should’ve been included in the Hot data, smart cache post.

Avere Systems made its first public appearance with the results of their SPEC 2008 NFS benchmark. The six node configuration using 79 disks achieved a record-setting combination of more than 131,000 operations per second throughput with a latency of 1.38 ms overall response time. The other SPEC08 benchmark leaders use 10 times as many disks and sometimes multiple filesystems to achieve competitive results.

Zetta was talking about their new cloud-based NAS platform. The architecture impresses. Starting at $0.25/GB/Month with a highly-redundant platform and open NAS interfaces, they are well-positioned to compete with standard NAS boxes for general purpose file storage.

Simply Continuous is focused on the backup/disaster recovery market and offers a cloud backup to Data Domain dedupe boxes.

In addition, 3 stealth mode companies said hello. We should hear more from them by early next year. And they weren’t all cloud either.

The StorageMojo take
SNIA and ComputerWorld squeezed a lot of cost – the shirts, live music, bags and the like – out of SNW, but none of the value. SNW is still the place to go for the latest in commercial storage information and education.

The Great Recession is forcing many organizations to look beyond what has worked towards what could work. Thanks to the rise of new architectures intelligent storage decisions are rewarded with greater savings and more operational flexibility than at any time in the past.

Courteous comments welcome, of course. No disclosures to make, darn it, but it was nice to be able to drive to SNW this time.

Related posts:

1. StorageMojo@SNW next week Finally, SNW is back in Phoenix, an easy 2 hour...
2. The top storage stories of 2008 The world of data storage is changing faster than it...
3. Cisco’s bong-sized cloud: telcos only? On my ZDnet blog I had some fun with the...

Related posts brought to you by Yet Another Related Posts Plugin.

1. StorageMojo@SNW next week Finally, SNW is back in Phoenix, an easy 2 hour...
2. The top storage stories of 2008 The world of data storage is changing faster than it...
3. Cisco’s bong-sized cloud: telcos only? On my ZDnet blog I had some fun with the...

These requests came in over the transom in the last couple of days. Maybe some StorageMojo readers have wisdom to share.

I have a question I hope you can help me with. My boss asked me . . . to research HP Left-hand SANs and Dell Equallogic SANs. Do you have any special knowledge of these products and, if so, would you make an informal recommendation?

What say you, StorageMojo readers? If you evaluated both, why did you make the choice you did? Vendors welcome to comment, but please identify yourself as such.

The StorageMojo take
AFAIK, both products are good iSCSI systems. Both are backed by major corporations. EqualLogic may be stronger in the channel today, but HP has channel chops as well. HP’s blade servers may be a more expandable platform, but EqualLogic’s software portfolio may be more affordable.

Translation: you could do worse than either of these.

Part II
Another customer perplexity: service.

We have a pair of HP disk arrays, EVA 8000 and 6000 and I am looking for a consultant to help up with storage planning. Do you do such work or could you recommend someone to me. I am looking for someone who goes beyond just being a seller, I have plenty of potential sellers already.

The writer is in a small city in the Mountain West, so you should be used to working remotely with clients. No, not in Arizona.

The StorageMojo take
HP folks may be wondering: why doesn’t he call HP? My guess: not big enough for a direct engagement.

Courteous comments welcome, of course.

Related posts:

1. Dear Uncle StorageMojo: CSI edition Continuing an occasional feature This just came over the transom....

Related posts brought to you by Yet Another Related Posts Plugin.

1. Dear Uncle StorageMojo: CSI edition Continuing an occasional feature This just came over the transom....

Sun announced the, or removed from stealth mode, the F5100, their flash-based storage array that uses SO-DIMM form-factor flash modules (see last month’s post for the StorageMojo take on the unannounced product). With 20 flash modules and 480 GB of capacity it starts at $50k, which means for big customers it will be less than $40k.

The box supports 64 SAS connections, zones, up to 1.9 TB of capacity and up to 9.7 GB/s sequential write bandwidth. Here’s the official Sun web page. Joerg Moellenkamp has a good short writeup as well. (Thanks, David!)

Here’s a picture:

The StorageMojo take
A shareable flash resource at $100/GB list should be popular. It should also get more data center guys thinking about power per IOP instead of just performance.

Another shot across the bow of the big iron storage flotilla and a nifty advance. Good luck to them.

Courteous comments welcome, of course. Would a project name like “The Beast” have upped the sex appeal?

Related posts:

1. The Sun 4 TB flash array F5100 The 4 TB Sun F5100 Flash Array product launch is...
2. The top storage stories of 2008 The world of data storage is changing faster than it...

Related posts brought to you by Yet Another Related Posts Plugin.

1. The Sun 4 TB flash array F5100 The 4 TB Sun F5100 Flash Array product launch is...
2. The top storage stories of 2008 The world of data storage is changing faster than it...

TDK recently demo’d an impressive technical achievement: a 10 layer optical disk with 320 GB capacity – using standard Blu-ray (BD) drive technology. Each layer has better than 90% light transmission and writing required no more than 20 mW of the 30 mW Blu-ray spec.

Too bad it will never be a commercial success. Optical is at the end of the line.

When do formats die?
When their combination of reliability, capacity, performance, density and cost aren’t competitive. Which is where optical is now – even 320 GB optical.

Some of you may remember punched paper tape – hot in the 60s and early 70s – and popular on 16 bit minicomputers back when 4k of RAM was respectable and 64k unaffordable. It was limited to a few dozen KB of capacity and unreliable in long-term use, so when 240KB 8” floppies arrived in 1973 paper tape was toast.

Floppies had to improve to compete with removable disk pack drives – like DEC’s RK05 family – with their 2 MB capacity and a screaming 150 KB/sec transfer rate, and floppies did by increasing capacity – what TDK demonstrated – and decreasing size, from 8” to 5.25” to 3.5”, and cost from over a thousand dollars for a drive to less than $20.

But floppies couldn’t keep up with the growing size of applications and data sets. The 100 MB Zip drive was insanely popular when introduced in 1994 – a woman offered me a $100 premium on the spot to buy mine at a Palo Alto sushi bar – but by 1999 the format was on the way out thanks to cheaper and more capacious CD-R drives.

Despite heroic efforts to increase removable magnetic disk capacities – culminating in 2001 with the 5.7 GB Orb drive – removable magnetic disk media is dead, killed by cheaper optical and more convenient flash media.

Removable: backup and transfer
Removable media has 2 major use cases: data backup and data transfer. Tape dominates removable media backup today with capacities rivaling the largest disks.

Thumb drives long ago replaced floppies for smaller file transfers – “sneakernet” – with external hard drives handling large capacities. With 1 TB 2.5” hard drives, even a writeable 50 GB Blu-ray (BD-R) can’t compete with a small hard drive in transfer speed or capacity.

TDK’s problem
Which gets us to the 10x Blu-ray problem: even if it were commercialized there would be no market. Why?

• Capacity. Successful optical media capacities have been competitive with current disks – CD-ROM in the early 90s; DVD-R in the early 2000s. Multi-layer Blu-ray will never be more than a small fraction of hard drive capacities.
• Performance. 24x Blu-ray transfer rates are half that of today’s disks. And as capacities increase, disks get faster. Not so with Blu-ray.
• Reliability. Early adopters report that BD burner disks often don’t play on many commercial players. That will get fixed someday, but multi-layer DB-R will have to solve it again.
• Density. Managing a single piece of media is much simpler than managing 6 or 10. External hard drive density makes them much more convenient.
• Cost. BD-playing DVD drives haven’t been popular on PCs, and BD burners are way more expensive, as is the media. A FireWire or USB 2 or 3 hard drive can be had for less than $100, has much faster access times, higher capacity and faster data transfer. With volume BD-R costs will come down – but where will the volume come from?

Multi-layer BD-R has advantages, especially if current BD players can be updated to use it. But there is no commercial justification for distributing content on 320 GB optical disks and there isn’t likely to be one.

Hollywood has a real chance to make 3D work this time, but 3D HD movies will fit fine on BD. Put a 3D “Band of Brothers” on a single disk? OK, but really, getting up every 50 minutes to change disks isn’t so hard, is it?

The Storage Bits take
New optical formats will get introduced – like 750 MB Zip drives and 5.7 GB Orb drives – but they’ll stumble around the fringes of consumer acceptance before a quiet death off stage. Many of the same forces that are killing BD – downloading, upconverting, cost – are closing in on optical media in general.

DVDs will be around for years – even as CDs still are – but the focus is shifting to online storage and local disks. The industry still hasn’t cracked the code on massive home disk storage, but that day is coming.

You’ll buy HD 3D content online, download it, store it in your digital library, and watch it when and where you want. If your house burns down your content suppliers will let you download again. Who needs the hassle to burn disks?

The one remaining piece is for hard drive vendors to get serious about building archive-quality hard disks. I love their technology, but they aren’t the most forward looking group.

Courteous comments welcome, of course. Anyone interested in buying a vintage USB Zip drive?

Related posts:

1. The top storage stories of 2008 The world of data storage is changing faster than it...
2. End of the line for the 1.8″ HDD? Ars Technica reported that Samsung has not found any buyers...

Related posts brought to you by Yet Another Related Posts Plugin.

1. The top storage stories of 2008 The world of data storage is changing faster than it...
2. End of the line for the 1.8″ HDD? Ars Technica reported that Samsung has not found any buyers...

Analog virtual, not Second Life virtual
StorageMojo is off to Storage Networking World in Phoenix, a mere 2 hour drive away. Our unfolding economic depression may be keeping many of you at home. Too bad: Phoenix is lovely this time of year.

Got a vendor question?
StorageMojo will be meeting with a number of vendors. Take a look at the list and then tell me what you’d like to ask them.

The companies currently scheduled include:

• QLogic
• HP
• Intel
• Whiptail
• Xiotech
• Zetta
• Texas Memory Systems
• Quantum
• Sepaton
• Simply Continuous

I’d also like to meet with Avere, but that isn’t scheduled. Other companies may pop up too.

Ask the questions in the comments or, if you’d prefer, email me.

The StorageMojo take
I won’t be blogging from the show – I’m going notebook-less and relying on an iPhone for IT support. Not sure how well that will work.

But I will write about the conference and what I learn. If you’re there, feel free to say hello. I still look a lot like my picture.

Courteous comments welcome, of course.

Related posts:

1. StorageMojo@SNW next week Finally, SNW is back in Phoenix, an easy 2 hour...
2. StorageMojo at SNW Orlando next week StorageMojo’s global HQ is packing up for Orlando on Monday...

Related posts brought to you by Yet Another Related Posts Plugin.

1. StorageMojo@SNW next week Finally, SNW is back in Phoenix, an easy 2 hour...
2. StorageMojo at SNW Orlando next week StorageMojo’s global HQ is packing up for Orlando on Monday...

A 2½ year study of DRAM on 10s of thousands Google servers found DIMM error rates are hundreds to thousands of times higher than thought — a mean of 3,751 correctable errors per DIMM per year. Another piece of hallowed Conventional Wisdom bites the dust.

Google and Prof. Bianca Schroeder teamed up on the world’s first large-scale study of RAM errors in the field. They looked at multiple vendors, DRAM densities and DRAM types including DDR1, DDR2 and FB-DIMM.

Every system architect and motherboard designer should read it. And I agree with James Hamilton’s suspicion that even clients need ECC – at least heavily used clients.

If you can’t trust DRAM . . .
Here are some hard numbers from DRAM Errors in the Wild: A Large-Scale Field Study by Bianca Schroeder, U of Toronto, and Eduardo Pinheiro and Wolf-Dietrich Weber, Google.

What you don’t know can hurt you
Most DIMMs don’t include ECC because it costs more. Without ECC the system doesn’t know a memory error has occurred.

Which is part of the reason people aren’t more concerned. Ignorance is bliss.

Everything is fine until a memory error means a missed memory reference or a flipped bit in file metadata writing to disk. What you see is a “file not found” or a “file not readable” message, silent data corruption – or even a system crash. And nothing that says “memory error.”

Conventional Wisdom
The industry take on DRAM is summed in a quote from an old AnandTech FAQ that took the industry at its word:

Everyone can agree that hard errors are fairly rare. . . . For the frequency of soft errors. . . . IBM stated . . . that at sea level, a soft error event occurs once per month of constant use in a 128MB PC100 SDRAM module. Micron has stated that it is closer to once per six months . . . .

An even bigger surprise: it appears that hard errors, not soft errors, are the dominant error mode – the reverse of the conventional wisdom. This conclusion isn’t solid – the study’s data set didn’t distinguish between hard and soft errors – but the circumstantial evidence is suggestive. There may be a another study coming that uses error address data to distinguish hard and soft errors.

Issues
The paper has a few issues that make it difficult to understand. One issue is the use of the chip industry’s Failure In Time (FIT) metric.

One FIT = one failure per billion hours per mbit.

Confused? Me too. Taken at face value, FIT suggests that a 2 GB DIMM – 16,000 Mbit – has 16x the errors of a 128 MB DIMM.

But that isn’t what the study found: higher density DRAM doesn’t have more errors per DIMM. The FIT metric is most useful for comparing with earlier studies.

Good news
The study had some good news:

• Temperature plays little role in errors – just as Google found with disk drives – so heroic cooling isn’t necessary. Good news for data center air economizer architectures.
• Density isn’t a problem. The latest, most dense generations of DRAM perform as well, error wise, as previous generations.
• Heavily used systems have more errors.
• No significant differences between vendors or DIMM types (DDR1, DDR2 or FB-DIMM). You can buy on price – at least for ECC DIMMS.
• Only 8% of DIMMs had errors per year on average. Fewer DIMMs = fewer error problems – good news for users of smaller systems. Bad news for large-memory servers running in-memory databases.

Bad news
Besides error rates much higher than expected – which is plenty bad – the study found that error rates were motherboard, not DIMM type or vendor, dependent. Some popular mobos must have poor EMI hygiene.

Route a memory traces too close to noisy components or shirk on grounding layers and instant error problems. Design or manufacturing problems in motherboards? The study did not do a root cause analysis.

Hardware failures are much more common as well and may be the most common type of memory failure. Google replaces all DIMMs with hard errors – as do most data centers – as a matter of policy.

The server error reporting could not always differentiate between hard and soft errors. Hard errors are discovered through memory tests run on off-line servers.

Other interesting findings
For all platforms they found that 20% of the machines with errors make up more than 90% of all observed errors on that platform. There be lemons out there!

In more than 93% of the cases a machine that sees a correctable error experiences at least one more in the same year. They don’t get better by themselves.

High quality error correction codes are effective in reducing uncorrectable errors. There are “chip-kill” DIMM/mobo combinations that can detect and correct 4 bit errors, but few vendors offer those. Kingston and Corsair don’t.

Besides costing more, ECC DIMMs are about 3-5% slower than unprotected DIMMs. Few of us would ever notice that small a performance hit, but gamers might care.

HPC users might care too, for a different reason. James Hamilton noted a talk by Kathy Yelick – she doesn’t keep her web site updated – where she found that ECC recovery times are substantial and the correction latency slows the computation.

The StorageMojo take
You’d think that after several decades of semiconductor DRAM usage that this study would be old news. I did.

Like most folks I accepted industry assurances that DRAM is reliable. My main machine – a Mac Pro with an Intel server-class mobo – has FB-DIMMs whose 5-watt-per-DIMM overhead has irritated me. But when I found one DIMM reporting errors recently I felt better about it.

I suspect this is another example of the industry’s code of omerta. System vendors have scads of data on disk drives, DRAM, network adapters, OS and filesystem based on mortality and tech support calls, but do they share this with the consuming public? Nothing to see here folks, just move along.

Kudos to Google for doing the long-term research required for substantive results and then sharing those results with the rest of us. I expect ECC systems will become a lot more popular in the years ahead.

Courteous comments welcome, of course. Note: Much of this was published on ZDnet Sunday night. This version is updated after speaking to Prof. Schroeder Wednesday. This version also dispenses with some consumer-oriented content.

Related posts:

1. Flash bash: disks and DIMMs Flash memory is opening a second front in its war...
2. Update on Cisco’s UCS Brief update on the Cisco WebEx conference this morning. I...
3. The top storage stories of 2008 The world of data storage is changing faster than it...

Related posts brought to you by Yet Another Related Posts Plugin.

1. Flash bash: disks and DIMMs Flash memory is opening a second front in its war...
2. Update on Cisco’s UCS Brief update on the Cisco WebEx conference this morning. I...
3. The top storage stories of 2008 The world of data storage is changing faster than it...

Finally, SNW is back in Phoenix, an easy 2 hour drive from the mountains of northern Arizona.

I’m looking to meet with as many companies as possible, as well as touring the show floor, shooting some video and maybe – maybe – doing some podcasts.

It looks like several interesting new companies are attending and I’m looking forward to seeing what’s new from the incumbents. Phoenix is nice in October – more reliable than Florida – and the room rates are low.

Always happy to meet StorageMojo readers as well.

See you there.

Related posts:

1. StorageMojo at SNW Orlando next week StorageMojo’s global HQ is packing up for Orlando on Monday...
2. Virtual SNW Analog virtual, not Second Life virtual StorageMojo is off to...
3. StorageMojo in San Diego later this week StorageMojo’s Global HQ is packing up for cooler climes later...

Related posts brought to you by Yet Another Related Posts Plugin.

1. StorageMojo at SNW Orlando next week StorageMojo’s global HQ is packing up for Orlando on Monday...
2. Virtual SNW Analog virtual, not Second Life virtual StorageMojo is off to...
3. StorageMojo in San Diego later this week StorageMojo’s Global HQ is packing up for cooler climes later...

Okay, we’ve figured out how to produce protected storage for $100 a terabyte . It has wide fan out so the bandwidth is modest. It uses large SATA disks so it isn’t great from an IOPS perspective either.

But it works.

What would it take to turn it into something that the average enterprise could use? Would a high-performance, scalable, high bandwidth, high capacity intelligent cache that automatically moved cool data off to the low cost backing store do the trick?

Several companies are betting it will.

The players
Gear6 has been around for a few years with a commodity-based clustered cache appliance that sits in front of existing filers.

F5 Networks also offers front end “intelligent file virtualization” with their ARX device.

Now a couple of new players are going public:

Avere Systems
Avere Systems is announcing their FXT cluster, an appliance made of storage bricks that each include RAM, SSD or flash, and 15 K. disks. The FX team cluster supports NFS and CIFS.

Tiering within the FXT cluster is automatic by access pattern, frequency and type of data. The data is tiered on-the-fly, with a hot file striped across multiple FXT servers, while cool data is pushed out the back end to file storage.

The FXT boxes support both GigE and 10GigE. In their testing the Avere team and its beta sites have found that for every 50 I/Os to the FXT cluster there is one I/O to the backend filers.

Avere is announcing this week with 2 2U rack mount nodes. Performance Go and 20 3K ops per second on a single node using the spec SFS 08 benchmark where the bandwidth of 1 GB per second on reads and 325 MB per second writes per node. They say they have achieved linear performance scaling to 25 nodes and their 1.0 release.

StorSpeed
StorSpeed says it is delivering the world’s first application-aware caching solution. Like Avere, Storspeed is offering a clustered front-end cache, but with extremely high performance: 1 million IOPS in a 3 node cluster; and 10GigE wirespeed bandwidth.

They use deep packet inspection to understand and manage traffic and capacity tiering. Expect more data on their web site when they announce later this week.

The StorageMojo take
These large scale, high performance caches are a logical extension of the disk controller model to network storage. Most data is rarely accessed but is too valuable to off line, thus the rationale for tiered storage.

Where tiered storage fails in practice is the intelligence required to put data in the right place: people just aren’t scalable enough to manage it. These caches bring extra intelligence to the problem of automated data movement without forcing wholesale rip-and-replace of existing infrastructure.

Enterprises can save many millions of dollars by keeping the mass of cool-to-cold data on cheap storage while keeping the hot working set on a smart cache. This could be the dawn of a new tier of storage.

Courteous comments welcome, of course. I did some work for Gear6 a couple of years ago but have no other business relationships with these firms. Rats!

Related posts:

1. Avere Systems: dynamic tiering for the masses – of data? Last week RisingTide Systems, a stealth startup with no web...
2. MaxiScale’s Web-scale file system A new web scale – they claim linear scaling to...
3. HP buys IBRIX Another scrappy startup bites the dust HP announced this morning...

Related posts brought to you by Yet Another Related Posts Plugin.

1. Avere Systems: dynamic tiering for the masses – of data? Last week RisingTide Systems, a stealth startup with no web...
2. MaxiScale’s Web-scale file system A new web scale – they claim linear scaling to...
3. HP buys IBRIX Another scrappy startup bites the dust HP announced this morning...

HP’s Tech Days this week in Colorado Springs impressed on two levels. First, their willingness to engage with the analysts and writers tagged with the disreputable term “blogger.” Second, the quality of the strategy they outlined for a unified computing and storage strategy.

The outline: use a dense CPU and storage commodity-based hardware infrastructure with layered cluster storage software to build flexible and resilient scale-out storage.

Strategy
The combination of LeftHand networks scale-out iSCSI and IBRIX scale-out NFS gives the company an excellent foundation. They are still thinking through what IBRIX means for them but the fundamental promise of a common hardware infrastructure whose compute resources can easily be repurposed to scale-out storage or application services is compelling.

One surprise was that the team hadn’t grasped the implications of pNFS for their strategy. Parallel NFS is part of the NFS 4.1 spec and should be market ready, if the schedule holds, in the second half of next year.

pNFS should be a major plus for HP. If you’re selling massive scalable storage it helps to have clients capable of consuming massive capacity and bandwidth.

Pothole
The biggest hole in HP’s strategy is their go-to-market plan. They don’t have one.

The wholesale rejection of EMC’s Atmos by the EMC sales force shows the depth of the problem. Salesmen would rather sell a $500,000 box on 1 PO rather than $500,000 on 5 POs spread over a year.

HP’s sales force is less combative than EMCs but they can count dollars just as well. Corporate is going to have to think long and hard to develop a plan to get HP sales excited about selling unified storage.

The StorageMojo take
Kudos to HP for bringing us in without requiring non-disclosures. NDA’s carry the implicit promise of retribution for analysts who display too much independence, as EMC well knows.

HP’s strategy and architecture isn’t as sexy as the Atmos strategy but it may be better aligned with the sweet spot of enterprise needs. The cutting edge computer science in Atmos offers great promise, but in LeftHand and IBRIX HP has much more mature software than Atmos will have for years.

If HP aligns their sales force with the scale-out commodity hardware strategy it will force EMCs sales people to take Atmos seriously. It is a new day in enterprise storage when customers have a choice of scalable commodity-based storage systems from two major vendors.

In the larger scheme of things both HP and EMC are well-positioned. It is IBM, Hitachi and NetApp that need to sharpen their games for an even more competitive storage market.

Courteous comments welcome, of course. Disclosure: HP picked up the travel and lodging tab and I’ve done work for IBRIX in the past.

Related posts:

1. Atmos gets no love from EMC sales A couple of reliable informants tell me the same story:...
2. HP buys IBRIX Another scrappy startup bites the dust HP announced this morning...
3. The top storage stories of 2008 The world of data storage is changing faster than it...

Related posts brought to you by Yet Another Related Posts Plugin.

1. Atmos gets no love from EMC sales A couple of reliable informants tell me the same story:...
2. HP buys IBRIX Another scrappy startup bites the dust HP announced this morning...
3. The top storage stories of 2008 The world of data storage is changing faster than it...

Thinking about cloud
Amid the hype and glitz on cloud storage and computing it can be difficult to separate the essential from the transitory. The word scale is abused; APIs are debated; business models are in flux: and new varieties of cloud infrastructure are being developed or marketed every month.

To get a handle on the concept I’ve developed a descriptive model that may help move the conversation forward.

The essential elements of cloud are scale and management. Everything else is negotiable – including cost.

Putting those on the axes of a graph gives a simple visual picture of the scale and management environment.

Scale is reasonably self-explanatory: single namespace; single management domain; reasonable upward performance increment per incremental dollar investment.

Management is perhaps more complex. Researchers at IBM have long championed the idea of autonomic — self managing — systems. At the highest level cloud systems require an autonomic management paradigm: there’s just too much gear and too many failures for people to fix. The infrastructure must be self healing, load balancing, and fault and disaster tolerant.

These are qualitative not quantitative metrics. However it is worth exploring why the other quadrants are named as they are.

• Appliance. This quadrant shares many of the same self management capabilities of the cloud but on a smaller scale. Today we see these systems popular with large volume imaging applications in medical and media production.
• Enterprise. Enterprises don’t have the luxury of a few primary application types. They need systems that adapt to a wide variety of legacy application requirements. In addition they face considerable regulatory and legal constraints that make tuning the storage infrastructure imperative.
• High-Performance Computing. HPC systems need to be highly tunable to meet specialized application requirements. When an application takes days or weeks to run even on few extra percentage points of performance out of the system translates into hours or days saved.

Vendors on the quad
In the second chart I’ve made a first-order approximation of where various systems set on the cloud quadrant. These positions are not cast in concrete or even, at this point, Jell-O. Nor should readers assume that any quadrant is superior to any other in a marketing or technical sense.

I ask readers and vendors for their help in creating a more comprehensive cloud quadrant. There are vendors that I know I left out and other vendors who may feel that they are scalability or management capabilities are wrongly estimated.

I expect to do more work on this in the weeks ahead. It may prove helpful in sorting out some of the currently not well differentiated scalable storage and compute markets.

The StorageMojo take
There is no doubt that Internet-based storage and computing represents a major paradigm shift, not unlike that of PC networks in the 80s and client server computing. In all of these shifts the imagined long-term benefits have far outweighed the immediate and very real costs.

But cloud computing is different: it is the first pay-as-you-go infrastructure. Every user can look at the price tag and make an economic decision based on real costs. In the 80s it took years for good data on the costs and benefits of PC networks to emerge. Good thing too, since CFOs would have screamed.

Tens of thousands of companies and individuals are adopting cloud today based on benefits they see and costs they pay. Yes, there is much hype around cloud computing. But the customers are voting with their dollars and that tells us there is a real economic advantage in cloud computing as well.

Courteous comments welcome, of course.

Related posts:

1. Cloud storage is a component The cloud storage hype has been bothering me for some...
2. Private clouds won’t fly Massive economies of scale make cloud computing and storage inevitable....
3. Clouds over Berkeley: the RADLab reviews cloud computing pt. 1 Cloud computing: it’s here; it’s real; and it’s cheap UC...

Related posts brought to you by Yet Another Related Posts Plugin.

1. Cloud storage is a component The cloud storage hype has been bothering me for some...
2. Private clouds won’t fly Massive economies of scale make cloud computing and storage inevitable....
3. Clouds over Berkeley: the RADLab reviews cloud computing pt. 1 Cloud computing: it’s here; it’s real; and it’s cheap UC...

A re-education camp for bloggers. If I start gushing on HP, slap me.

Starts tomorrow in Colorado Springs. I’ve heard they’re flying in bloggers from Europe, which may lend tone to the event.

Can you spell “virtualization?”
The agenda includes

• Enterprise storage virtualization
• SMB shared storage for virtual servers – LeftHand
• Hands-on Enterprise Virtual Arrays
• SAN virtualization services
• Other unified, converged, bladed, low-ended server stuff

No ExDS 9100, no flash, no PolyServe, no IBRIX. Not even a cocktail party on the agenda. Whoa!

Transparency moment
HP has their hooks deep into me. Not only was I the product manager for the 1st DEC StorageWorks product, but if I can keep HP going for another 15 years I may get a pension from them. Good for a daily nonfat double decaf soy latte.

The StorageMojo take
Looking forward to meeting fellow bloggers and maybe bumping into DEC colleagues. Glad to see they aren’t requiring non-disclosure agreements, unlike EMC. Maybe someone will even explain why they don’t think file servers are a market.

Courteous comments welcome, of course. Fun Fact: on a clear day – a common occurrence – you can see Cheyenne Mountain, leaky home of the Strategic Air Command and ground zero for global thermonuclear war.

Related posts:

1. Microsoft out for VMware blood Microsoft has VMware in its sights and there will be...

Related posts brought to you by Yet Another Related Posts Plugin.

1. Microsoft out for VMware blood Microsoft has VMware in its sights and there will be...