Data Reduction improves the case for the cloud for telecommunications

| Networking @

You probably have already made a commitment to the cloud because it enables you to flexibly deliver IT resources more quickly and at a lower cost.  IT buyers are steadily shifting towards cloud-first strategies where they can rapidly adapt to market dynamics as they are no longer bound by legacy IT constraints. Public, private, or hybrid clouds are choices every C-level executive is making today. Each are different — for example, public cloud is shared with other businesses to yield economies of scale in Amazon Web Services (AWS), Google, Microsoft, while private cloud is either on-premises or hosted by a public cloud provider. Hybrid is a mix of both approaches, with different workloads deployed in each based on need. IDC reports that clouds are rapidly evolving to become more trusted, more intelligent, and more specialized for particular industries and workloads.

The cloud’s raison d’être, regardless of the deployment model used, is its ability to deliver IT business agility, deployment flexibility, and elasticity. Cloud priorities today include moving more workloads to the cloud, optimizing existing cloud utilization, leveraging innovation, and enabling multi-cloud deployments.

As businesses deploy cloud infrastructures, they embrace efficiency techniques that have been developed and used by Amazon, Google, and Microsoft to control their public cloud data center costs. These companies deploy efficiency models that increase data density and reduce footprint requirements, while dropping operating costs for power and cooling. As these extremely efficient models are deployed, legacy purpose-built hardware is being replaced with software-defined data centers running on industry-standard servers

Software-defined data centers usher in new opportunities to maximize efficiency in software. One such feature, which is particularly effective and critical in cloud environments, is inline data reduction. In addition to the platforms and software efficiency of cloud, data reduction delivers a substantial impact on your business by reducing the amount of data stored. Data reduction chops the amount of storage consumed, increases data density further, and lowers the costs of data at rest and in flight over your networks. No matter which cloud deployment you use, data reduction delivers economic benefits that make the cloud business case more compelling.

If you are deploying in a public cloud

Every day new workloads are being deployed in public clouds. Worldwide public IT cloud service revenue in 2018 is predicted to be $127B. The economics that public cloud delivers are undeniable. Amazon, Google, and Microsoft growth in the public cloud is testament.

As you deploy a public cloud environment, consider that data reduction technology shrinks public cloud costs. For example, data reduction technology (deduplication and compression) typically cut capacity requirements of block storage in enterprise public cloud deployments by up to 85% (6:1). Take your cloud block storage bill, divide by 6, and that is the business case.

The following Amazon cloud deployment example employing data reduction demonstrates how data reduction delivers substantial savings:

If you provision 300 TB of General Purpose SSD storage for 12 hours per day over a 30-day month in a region that charges $0.10 per GB-month, you would be charged $15,000 for the storage.

With 6:1 data reduction, that monthly cost of $15,000 would be reduced to $2,500. Over a 12 month period you will save $150,000.

Bottom line, data reduction reduces costs of public cloud deployments.

If you are deploying in a private cloud environment

Organizations see similar benefits when they deploy data reduction in private clouds. IDCpredicts$17.2B in infrastructure spending for private cloud in 2017. This demand reflects requirements for cloud’s increased efficiency, flexibility, privacy, performance, and security.

The business case for data reduction in private cloud is based on reducing the cost of both storage hardware and excessive annual software licensing. For example, Software-Defined Storage (SDS) solutions are typically licensed by capacity and their costs are directly proportional to storage device expenses. Data reduction decreases storage costs because it reduces storage consumption, as demonstrated in the following example:

You deploy a private cloud configuration with 1 PB of storage infrastructure and SDS. Assuming a current hardware cost of $500 per TB for commodity server-based storage infrastructure with datacenter-class SSDs and a cost of $56,000 per 512 TB for the SDS component, you would pay $612,000 in the first year. In addition, annual software subscriptions over three years cost $836,000 for 1 PB of storage and $1,060,000 over five years,.

In comparison, the same configuration with 6:1 data reduction over five years will cost $176,667 for hardware and software, resulting in $883,333 savings.

If you are deploying a hybrid cloud

Hybrid cloud is the preferred cloud deployment approach today because it addresses data security concerns while still leveraging cloud efficiency. On-premises resources (private cloud) combined with colocation and multiple public clouds result in  a highly redundant data environment. For example, IDC’s FutureScape report finds “Over 80% of enterprise IT organizations will commit to hybrid cloud architectures, encompassing multiple public cloud services, as well as private clouds by the end of 2017.” (IDC 259840)

One consideration is whether to depend on a single cloud storage provider, which can pose a significant risk to Service Level Agreement targets. Consider the widespread AWS S3 storage errors that occurred on February 28th 2017, where data was not available to clients for several hours. Businesses lost millions of dollars of revenue due to loss of data access. This highlighted requirements for a “Cloud of Clouds” approach where data is redundantly distributed across multiple clouds for data safety and near continuous accessibility. IDC forecasts that 85% of cloud deployments will be multi-cloud by 2018. Unfortunately, the Cloud of Clouds approach increases storage capacity cost (by having redundant copies in multiple clouds), and adds the networking cost to move and sync data between cloud deployments.

That’s where data reduction comes in, as demonstrated in the following example:

In hybrid cloud deployments where data is replicated to the participating clouds, data reduction multiplies capacity and cost savings.  If three copies of the data are kept in three different clouds, three times as much data is saved and data movement between clouds to sync them can be costly.

Take the private cloud example above where data reduction drove down the costs of a 1 PB deployment to $176,667, resulting in $883,333 in savings over five years. If that PB of data is replicated in three different clouds, the savings would be multiplied by three times for a total savings of $2,649,999.

Data reduction described

One data reduction application that can readily be applied in public, private, and hybrid clouds is Permabit’s Virtual Disk Optimizer (VDO), a pre-packaged software solution that installs and deploys in minutes on Linux operating systems. Because it is deployed directly with Linux, it can be easily deployed in any public or private cloud today.

OS-based data reduction solutions such as Permabit VDO address public cloud, private cloud (including on-premises and hosted private clouds), and the bandwidth challenges faced in hybrid cloud environments. Data reduction can reduce storage requirements and network bandwidth consumption by as much as 85% (6:1 data reduction).

Data reduction solutions generally combine a number of techniques to reduce data footprint. For example, Permabit VDO applies three reduction techniques:

  1. Zero-block elimination uses pattern matching techniques to eliminate zero data blocks
  2. Inline Deduplication eliminates duplicate data blocks
  3. HIOPS Compression™ compresses the remaining data blocks


The graphic below visually demonstrates how simple data reduction really is and its impact on storing data.

VDO DRe process


Data reduction delivers compelling cost reduction that substantially improves the business case in every cloud deployment model. No matter which cloud approach you choose, the cost savings benefits from data reduction should not be ignored and must be a component of your cloud strategy.

IT professionals are finding that the future of IT infrastructure lies in the cloud. Data reduction technologies enable clouds — public, private, and hybrid — to deliver business agility and elasticity at the lowest possible cost, making cloud the deployment model of choice for IT infrastructure going forward.



Read more

Deploying VDO Data Reduction on Red Hat Atomic Host

| By: (56)

All of the buzz about containers is a bit surprising to many people who’ve watched operating system technology evolve over the years.  After all, many of the core concepts behind running isolated applications on a shared OS has been around on UNIX for over 20 years.  So what’s so exciting?  Well, to understand the container revolution you first have to look at Virtual Machines (VMs) and their impact on the…

Read more


Data Center Optimization: How to Do More Without More Money

| Data Center Knowledge

Data centers are pushing the boundaries of the possible, using new paradigms to operate efficiently in an environment that continually demands more power, more storage, more compute capacity… more everything. Operating efficiently and effectively in the land of “more” without more money requires increased data center optimization at all levels, including hardware and software, and even policies and procedures.

Although cloud computing, virtualization and hosted data centers are popular, most organizations still have at least part of their compute capacity in-house. According to a 451 Research survey of 1,200 IT professionals, 83 percent of North American enterprises maintain their own data centers. Only 17 percent have moved all IT operations to the cloud, and 49 percent use a hybrid model that integrates cloud or colocation hosts into their data center operations.

The same study says most data center budgets have remained stable, although the heavily regulated healthcare and finance sectors are increasing funding throughout data center operations. Among enterprises with growing budgets, most are investing in upgrades or retrofits to enable data center optimization and to support increased density.

As server density increases and the data center footprint shrinks, any gains may be taken up by the additional air handling and power equipment, including uninterruptable power supplies and power generators. In fact, data center energy usage is expected to increase by 81 percent by 2020, according to CIO magazine.

Often, identifying and decommissioning unused servers during a data center optimization project is a challenge, along with right-sizing provisioning.

Virtualization makes it easy to spin up resources as needed, but it also makes tracking those resources harder. The result is that unused servers may be running because no one is certain they’re not being used. A study by the Natural Resources Defense Council and Anthesis reports that up to 30 percent of servers are unused, but still running.

A similar principle extends to storage. While data deduplication (removing duplicate files) is widely used, over-crowded storage remains an issue for small to medium-sized enterprises (SMEs). Deduplication can free much-needed storage space.  For example, data deduplication along with compression can shrink data storage consumption by up to 85%.  This not only addresses the budget issues mentioned above but also helps with data density much like the server density mentioned earlier.  Imagine that you can save money with less storage and increase your data density at the same time .  Looks lie a win-win!

If data center optimization is concerned with saving money, managers also should examine their purchasing programs. NaviSite looked for cost efficiencies within volume projects and looked at large commodity items like cabinets, racks, cabling and plug strips eliminated middlemen whenever possible. For big purchases go directly to the manufacturers in China and seek innovative young technology vendors working with them to design specifications that significantly lower the price.

Data center optimization, clearly, extends beyond hardware to become a system-wide activity. It is the key to providing more power, more capacity and more storage without requiring more money.

* This article is quite long you may want to read the source article which can be found by clicking on the link below:


Read more


Enterprise Storage Extensive Growth Opportunities by 2026


With the increased focus on virtualization and cost of operations; simplicity and convergence; and the cloud, enterprises are moving from traditional enterprise storage system to software-defined storage and cloud storage to provide cost effective real-time storage services. Therefore, it has been observed that traditional Enterprise Storage Systems market has declined over the past few years.

Most of the enterprises are implementing cloud based storage systems due to low cost and greater agility and it also observed that there are companies which follow the hybrid cloud strategy where traditional and cloud storage are used together. This approach fuel the demand for traditional enterprise storage system and cloud storage system where critical workloads can be managed securely.

Enterprises are seeking for more efficient storage systems, as increasing focus on digitization creates huge amount of data which fuel the demand for innovative storage solutions. It has been observed that smaller enterprises drive the cloud storage market and large enterprises drive hybrid approach storage.

A significant tool in containing storage costs in any cloud or hybrid cloud is the application of data reduction technology which can easily deploy in any cloud deployment. Permabit VDO delivers data reduction up to 85% in public, private or hybrid cloud.

Due to the rise in the volume of structured and unstructured data and the need to backup and archive the files at reduced costs also propel the market growth for enterprise storage systems.

By offering a better price and reducing infrastructure and management costs and providing the enhanced security features enterprise storage systems market witness with the growth in future.
Enterprise storage systems market is segmented on the basis of type of storage and regions.

Read more


Global Cloud Storage is grow at a CAGR of 25% by Forecast to 2023


In this rapidly changing world of technology, cloud storage market is gaining immense popularity owing to its ability to easily integrate with the already existing infrastructure of the enterprise. Cloud storage gateway solution provides features like encryption and data reduction technology with compression and data deduplication adds cost reduction and security to the data. It also allows rapid transfer of data to the cloud since the data is reduced and network traffic minimized.

As compared to other regions, the cloud storage market in North America is expected to witness a significantly healthy growth is accounted for the highest market share throughout the forecast period. U.S and Canada are anticipated to drive the growth owing to the presence of large number of established players of cloud storage solutions in the cloud storage market. In addition to this, the region also has a well-established infrastructure and higher internet penetration. Moreover, increasing adoption of cloud storage by small and medium enterprises is expected to be a major factor for the growth of cloud storage market.

The Cloud Storage Market is growing rapidly over 25% of CAGR and is expected to reach at approx. USD 104 billion by the end of forecast period.

Read more


Application consistency for enterprise multi-cloud and data reduction

| Networking information, news and tips


The cloud era has arrived in a big way as businesses of all sizes are looking to increase their level of IT agility. But when it comes to cloud, one size certainly does not fit all. Businesses have a wide range of options, including the use of a private cloud and a wide range of public cloud providers. My research finds that 82% of businesses will operate a hybrid cloud environment in the next five years.

This is consistent with the findings of F5’s State of Application Delivery in 2017 report, which the company released the results of last week at its annual EMEA Agility Conference in Barcelona. The study polled approximately 2,220 customers across the globe about their plans for the cloud and the challenges they face. Some interesting statistics from the survey that will affect a multi-cloud strategy are as follows:

  • 80% are committed to multi-cloud architectures
  • 20% will have more than half of their applications running in a public and/or private cloud this year
  • 34% of organizations lack the skills necessary to secure the cloud
  • 23% lack other skills specific to cloud
  • Organizations will deploy an average of 14 application services necessary to optimize and secure cloud services, with the top five being network firewall, antivirus SSL VPN, load balancing and spam mitigation

In addition to the above challenges, the cost of multi-cloud deployment when using it for data replication can become excessive as can the network costs. The addition of data reduction technology to the IT stack can mitigate these costs by as much as 85%. See Data Reduction Reduces the Cost of Cloud Deployment for more specifics.

Read more


Federal Agencies Optimize Data Centers by Focusing on Storage using Data Reduction


In data centers, like any piece of real estate, every square foot matters.

“Any way we can consolidate, save space and save electricity, it’s a plus,” says the State Department’s Mark Benjapathmongkol, a division chief of the agency’s Enterprise Server Operation Centers.

In searching out those advantages, the State Department has begun investing in solid-state drives (SSDs), which provide improved performance while occupying substantially less space in data centers.

In one case, IT leaders replaced a disk storage system with SSDs and gained almost three racks worth of space, Benjapathmongkol says. Because SSDs are smaller and denser than hard disk drives (HDDs), IT staff don’t need to deploy extra hardware to meet speed requirements, resulting in massive space and energy savings.

Options for Simplifying Storage Management

Agencies can choose from multiple technology options to more effectively and efficiently manage their storage, says Greg Schulz, founder of independent analyst firm Server StorageIO. These options include: SSDs and cloud storage; storage features such as deduplication and compression, which eliminate redundancies and store data using less storage; and thin provisioning, which better utilizes available space, Schulz says.

Consider the Defense Information Systems Agency. During the past year, the combat support agency has modernized its storage environment by investing in SSDs. Across DISA’s nine data centers, about 80 percent of information is stored on SSD arrays and 20 percent is running on HDDs, says Ryan Ashley, DISA’s chief of storage.

SSDs have allowed the agency to replace every four 42U racks with a single 42U rack, resulting in 75 percent savings in floor space as well as reduced power and cooling costs, he says.

Deduplication Creates Efficiencies

Besides space savings and the fact that SSDs are faster than HDDs, SSDs bring additional storage efficiencies. This includes new management software that automates tasks, such as the provisioning of storage when new servers and applications are installed, Ashley says.

The management software also allows DISA to centrally manage storage across every data center. In the past, the agency used between four to eight instances of management software in individual data centers.

“It streamlines and simplifies management,” Ashley says. Automatic provisioning reduces human error and ensures the agency follows best practices, while central management eliminates the need for the storage team to switch from tool to tool, he says.

DISA also has deployed deduplication techniques to eliminate storing redundant copies of data. IT leaders recently upgraded the agency’s backup technology from a tape system to a disk-based virtual tape library. This type of approach can accelerate backup and recovery and reduce the amount of hardware needed for storage.

It also can lead to significant savings because DISA keeps backups for several weeks, meaning it often owns multiple copies of the same data. But thanks to deduplication efforts, the agency can store more than 140 petabytes of backup data with 14PB of hardware.

“It was a huge amount of floor space that we opened up by removing thousands of tapes,” says Jonathan Kuharske, DISA’s deputy of computing ecosystem.

Categorize Data to Go Cloud First

To comply with the government’s “Cloud First” edict, USAID began migrating to cloud services, including infrastructure and software services, about seven years ago.

Previously, USAID managed its own data centers and tiered its storage. But the agency moved its data to cloud storage three years ago, Gowen says, allowing USAID to provide reliable, cost-effective IT services to its 12,000 employees across the world. The agency, which declined to offer specific return on investment data, currently uses a dozen cloud providers.

“We carefully categorize our data and find service providers that can meet those categories,” says Gowen, noting categories include availability and security. “They just take care of things at an affordable cost.”

For its public-facing websites, the agency uses a cloud provider that has a content distribution network and can scale to handle sudden spikes in traffic.

In late 2013, a typhoon lashed the Philippines, killing at least 10,000 people. In the days following the disaster, President Obama announced USAID sent supplies including food and emergency shelter. Because the president mentioned USAID, about 40 million people visited the agency’s website. If USAID had hosted its own site, it would have crashed. But the cloud service provider handled the traffic, Gowen says.

Our service provider can scale instantaneously to 40 million users, and when visitors drop off, we scale back,” he says. “It’s all handled.”


Such transitions are becoming commonplace. Improving storage management is a pillar of the government’s effort to optimize data centers. To meet requirements from the Federal Information Technology Acquisition Reform Act (FITARA), the Data Center Optimization Initiative requires agencies transition to cost-effective infrastructure.

While agencies are following different paths, the result is nearly identical: simpler and more efficient storage management, consolidation, increased reliability, improved service and cost savings. The U.S. Agency for International Development, for example, has committed to cloud storage.

“Our customers have different needs. The cloud allows us to focus on categorizing our data based on those needs like fast response times, reliability, availability and security,” says Lon Gowen, USAID’s chief strategist and special advisor to the CIO. “We find the service providers that meet those category requirements, and then we let the service providers focus on the details of the technology.”

To read the complete article click on the link below;


Read more


Cloud Economics Drive the IT Infrastructure of Tomorrow

| CloudPost

The cloud continues to dominate IT as businesses make their infrastructure decisions based on cost and agility. Public cloud, where shared infrastructure is paid for and utilized only when needed, is the most popular model today. However, more and more organizations are addressing security concerns by creating their own private clouds. As businesses deploy private cloud infrastructure, they are adopting techniques used in the public cloud to control costs. Gone are the traditional arrays and network switches of the past, replaced with software-defined data centers running on industry standard servers.

Features which improve efficiency make the cloud model more effective by reducing costs and increasing data transfer speeds. One such feature which is particularly effective in cloud environments is inline data reduction. This is a technology that can be used to lower the costs of data in transit and at rest. In fact, data reduction delivers unique benefits to each model of cloud deployment.

For the entire article please click on the link below;

Read more


Using Data Reduction at the OS layer in Enterprise Linux Environments

| Stock Market

Enterprises and cloud service providers that have built their infrastructure around Linux should deploy data reduction in the operating system to drive costs down, say experts at Permabit Technology Corporation, the company behind Permabit Virtual Data Optimizer (VDO).  Permabit VDO is the only complete data reduction software for Linux, the world’s most popular server Operating System (OS). Permabit’s VDO software fills a gap in the Linux feature set by providing a cost effective, alternative to the data reduction services delivered as part of the two other major OS platforms – Microsoft Windows and VMware. IT architects are driven to cut costs as they build out their next generation infrastructure with one or more of these OS platforms in  public and/or private cloud deployments and one obvious way to do so is with data reduction.

When employed as a component of the OS, data reduction can be applied universally without lock-in of proprietary solutions. Adding compression, deduplication, and thin provisioning to the core OS, data reduction benefits can be leveraged by any application or infrastructure services running on that OS. This ensures that savings accrue across the entire IT infrastructure, delivering TCO advantages no matter where the data resides. This is the future of data reduction – as a ubiquitous service of the OS.

“We’re seeing movement away from proprietary storage solutions, where data reduction was a key differentiated feature, toward OS-based capabilities that are applied across an entire infrastructure,” said Tom Cook, Permabit CEO.  “Early adopters are reaping financial rewards through reduced cost of equipment, space, power and cooling. Today we are also seeing adoption of data reduction in the OS by more conservative IT organizations who are driven to take on more initiatives with tightly constrained IT budgets.”

VDO, with inline data deduplication, HIOPS Compression®, and fine-grained thin provisioning, is deployed as a device-mapper driver for Linux. This approach ensures compatibility with a full complement of direct-attached/ephemeral, block, file and object interfaces. VDO data reduction is available for Red Hat Enterprise Linux and Canonical Ubuntu Linux LTS distributions.

Advantages of in-OS data reduction technology include:

  • Improved density for public/private /hybrid cloud storage, resulting in lower storage and service costs
  • Vendor independent to function across hardware running the target OS
  • Seamless data mobility between on-premise and cloud resources
  • Up to six times lower IT infrastructure OpEx
  • Transparent to end users accessing data
  • Requires no modifications to existing applications, file systems, virtualization features, or data protection capabilities

With VDO, these advantages are being realized on Linux today. VDO deployments have been completed (or are currently in progress) with large telecommunications companies, government agencies, financial services firms and IaaS providers who have standardized on Linux for their data centers. With data reduction in Linux, enterprises achieve vendor independence across all Linux based storage, increased mobility of reduced data and hyper scale economics. What an unbeatable combination!

Read more