Top 10 Questions to Ask Your Storage Provider about Data Efficiency

Top 10 Questions to ask your Storage Provider about Data Efficiency: Question #1- Block Size

| By: (135)

Question 1: At what granularity (block size) does your technology recognize duplicates? Best Answer: 4 KB blocks Unlike storage for backup, primary storage is characterized by high random access throughput and low latency. To be effective in primary storage, deduplication needs to scale with customers’ performance requirements and to run inline. For high-performance, flash-based storage devices, it must be able to operate at or above the 1M IOPS level when…

Read more

wpid-curata__68fd690c3b45824fc3ee2945970186c6.PNG

What is….Compression

| By: (301)

This is the third installment in the What is Series.  We’ll publish What is… on a weekly basis to inform, educate and socialize better understanding of data efficiency technology and its business and technology benefits. After reviewing data deduplication let’s turn our attention to compression and discuss how these technologies differ and how they should work together to achieve maximum data reduction.  Like all data reduction techniques compression finds and…

Read more

Tough Challenges Ahead for Pure Storage

| By: (56)

Pure Storage announced its latest round of funding last  week and at this point the investment community has them valued at over $3 Billion USD. What’s more, the key differentiating technology that has the investment community so excited isn’t flash — everyone has flash these days — it’s cost-efficient performance driven by Data Efficiency (deduplication and compression).   In a recent post, Permabit CEO Tom Cook asks the question, “Can Pure build…

Read more

Preventing Performance Bottlenecks with Inline Deduplication

| By: (48)

Implementing high performance in enterprise storage is a constant battle to find and eliminate the next system bottleneck.  Normally this alternates between limits of the underlying media and the computational overhead of metadata management, but choosing the wrong approach to deduplication can introduce a third performance challenge that can be impossible to overcome.  Storage that implements a multi-pass approach to data optimization, such as staged or post-process deduplication, becomes inherently…

Read more

CATEGORIES: Jered Floyd, CTO
what is

What is…data efficiency?

| By: (301)

This is the first in the What is….series. We’ll publish What is… on a weekly basis to inform, educate and socialize better understanding of data efficiency technology and its business and technology benefits. Permabit is committed to the concept that data efficiency is the highest impact technology in storage today.  While data reduction is primarily concerned with minimizing the total amount of data that needs to be stored, Permabit’s definition…

Read more

deflated

Who wins in a deflated, 3rd Platform Storage World?

| By: (61)

3 Ways EMC, IBM, NetApp and HP will compete with Google and Amazon. Q1 2014 numbers are out and the storage business is in trouble.   EMC storage was down 3%, IBM storage – down 23%, NetApp – down 1.2% and HP storage – flat. Meanwhile Amazon Web Services and Google are experiencing rapid growth.  Deflation has officially hit the incumbent storage market driven by movement to a 3rd Platform and…

Read more

up

Pure Storage looks up at EMC XtremIO?

| By: (61)

Looking up at EMC XtremIO? It’s been an exciting day in the storage industry. EMC held a coming out party for XtremIO – their all flash array.  When EMC makes such a significant announcement people listen.  Notably they have shipped a reported $30-50M of XtremIO. Are they the new industry leader in flash storage?  Time will tell, but that is a good bet. I saw an interesting comment from Scott (I raised $150M)…

Read more

data

ZFS compression and Permabit Albireo COMPRESS compared

| By: (56)

In my recent article ZFS dedupe just doesn’t make any sense, I questioned why anyone would use ZFS deduplication. I’m not going to ask that question about ZFS compression, from what I’ve read it’s a well designed feature that for some use cases can actually speed up the performance of spinning disk. What’s missing from ZFS is frankly functional deduplication and that’s a shame because fast deduplication can actually speed…

Read more

speedo

VDO at One Million IOPS: Zero Hour for Tier Zero

| By: (56)

Yesterday Permabit announced that Albireo VDO has achieved 1 million sequential IOPS and 500 thousand random IOPS, which (to the best of my knowledge) are the highest performance numbers achieved by anyone, ever for a storage system with deduplication.  As a follow on, I wanted to provide some background on why we bothered to collect these numbers, how we got them, and what they mean to the industry as a…

Read more