Data Deduplication by Permabit

Powered by Scalable Data Reduction™ (SDR)

First generation deduplication technology attempted to solve just a backup issue. Permabit Deduplication 2.0, powered by Scalable Data Reduction (SDR), addresses the real storage management problem - optimizing your entire storage environment.

Permabit’s SDR technology combines high performance data deduplication with traditional compression techniques. Permabit’s massively scalable deduplication approach identifies segments of data within incoming data streams that are duplicates of segments already stored. Instead of storing additional redundant copies of these segments, Permabit stores additional references to the existing copies. Traditional compression techniques then compress any remaining segments before data is stored to disk.

Permabit’s deduplication technology is much more effective than traditional data deduplication techniques alone because it compares new incoming data with a complete history of all previously stored data.  The actual level of data reduction obtained by Permabit’s customers depend on the frequency of archive events, the length of time archive data is retained, and the inherent redundancy of the archived data.

SDR and Snapshots

SDR also enables fast and efficient data snapshot capabilities.  Permabit snapshots can be later used to access information that may have been inadvertently deleted from an active Permabit volume.  Snapshots of a volume are created automatically at scheduled intervals or can be triggered manually by an administrator.

These snapshots can be used for versioning, for compliance purposes (to prove the state of data at a specific point in time), and as a fast and efficient data restoration mechanism for recovering inadvertently deleted information.

SDR and Replication

SDR is also utilized within Permabit’s replication technology.  This allows replication to be optimized for a Wide Area Network (WAN) by only transmitting unique data that doesn’t already exist at the destination storage grid.  The access nodes compare digital fingerprints across sites and if there is a match, the data is not sent over the wire, only a pointer is updated.  This reduces the total amount of data that needs to be transmitted making replication very efficient and reduces line costs.

Permabit SDR Features:

• Built–in:  SDR is a standard feature of the Data Center Series product line.   There are no additional licenses, software, or hardware to purchase.

• Massively Scalable:  Patented technology allows SDR to scale across an entire storage grid making Permabit Enterprise Archive the most scalable data deduplication–based archive in the industry.

• In–line Deduplication:  Data is deduplicated in–line and real–time allowing for data to be written directly to the storage nodes.  This technique saves storage space because you don’t need to cache the information and process it afterwards.

• Sub–file Level Deduplication:  Sub–file level deduplication provides a much higher reduction rate than file–based single instance storage technologies.

• Secure Digital Fingerprinting:  Deduplication leverages the highest standard SHA–256 hashing algorithm, avoiding potential hash collisions that can be found in commonly used MD5 and SHA–1 hashing algorithms.

• Compression:  Compression can be enabled to further reduce the storage footprint.

• Replication:  SDR is utilized within Permabit’s replication technology providing a WAN optimized solution that eliminates replicating redundant data.

• Snapshots:  SDR is leveraged within Permabit’s snapshotting technology allowing for thousands of snapshots to be taken while only consuming a fraction of the storage that the original data set required.