What is De-Duplication and How Do I Do It?

When collecting electronically stored information (“ESI”) from multiple custodians (i.e., various individuals/ different sources), there will necessarily be duplicative documents collected in the process.  In company-wide e-mail chains, for example, a message is sent to multiple recipients and stored within each recipient’s mailbox.  Consider the following: I send an email to two colleagues; a copy of the very same email now exists in each colleague’s mailbox.  Depending on the company’s data retention policies, copies of that same e-mail file may also reside on the employee’s (or employees’) hard drive(s), the company’s file server, and/or the company’s backup system.

A look into Data Deduplication feature and its advantages!

IT Professionals related to data storage field might have come across the term “Data De-Duplication” by now. But still there exist a small proportion of them who are connected to the field somehow, but are not familiar with the term and its real benefits. So, here’s a small post for them to know what exactly is Data Deduplication aka Dedup and its benefits.

3 DE-DUPLICATION OPTIONS: HOW DO YOU CHOOSE?

When collecting raw ESI from multiple individuals, there are bound to be tremendous amounts of duplicative documents. In company-wide e-mail chains, for example, a message is sent to multiple recipients and stored within each individual’s mailbox. Depending on your organization’s data retention policies, copies of the same file might also be found on the employee’s hard drive, file server, or company backup tape.When collecting raw ESI from multiple individuals, there are bound to be tremendous amounts of duplicative documents.

Near Deduplication and Email Threading

Deduplication is just one of the tools to help you save time and money.  As mentioned last week, data collections are growing bigger and bigger every day.  Deduplication will help you identify and exclude those documents so your reviewers spend less time reading the same document over and over again, but how can we take this to the next level?  That’s where Near Deduplication and Email Threading come in.  The time saved by identifying near duplicates and email threads can considerably streamline your review process and maintain consistency on how documents are reviewed.

The benefits of deduplication and where you should dedupe your data

To identify duplicates, data can be examined in different ways depending on the technology used. For example, file-level dedupe—also called single-instance storage(SIS)—will identify identical files, store a single copy and replace subsequent identical copies with a pointer to the unique version stored. Examples of file-level deduplication include Novell Inc.’s GroupWise and Microsoft Corp.’s Exchange (although SIS isn’t supported in Exchange 2010) email programs. EMC Corp. also provides file-level deduplication on its storage arrays, including Clariion, Celerra and its new VNX series.

Deduplication: Benefits and Costs

We know that the amount of data we store is exploding. Not only are we collecting more detailed information about specific things (e.g. servers, digital images, etc.), but we are also collecting information about more things (e.g. refrigerators, automobiles, etc.). We are quite literally experiencing the “Internet of Things” where uniquely identifiable objects are connected through modern networking technology to provide us with an abundance of information.

A look into Data Deduplication feature and its advantages!

IT Professionals related to data storage field might have come across the term “Data De-Duplication” by now. But still there exist a small proportion of them who are connected to the field somehow, but are not familiar with the term and its real benefits. So, here’s a small post for them to know what exactly is Data Deduplication aka Dedup and its benefits.