Data Deduplication Demo

Data Deduplication can save valuable amounts of hard drive space. In today’s cost conscious environments, saving hard drive space can translate into budgets that can be utilized elsewhere. The question that often pops up is “How much space will data dedup save me?” Unfortunately, there is no way to make a accurate prediction. Data dedup works best with static data. That is because there is no reason to dedup data that changes often.
The PowerShell code below will generate a few thousand text files that will share a lot of common bit patterns. This will help to demonstrate some space savings with dedup.

$String

$NewLineIndex = 0

For ($X=0;$X -lt 10000;$X++)

{

$C1 = [Char]((Get-Random(35)) + 65)

$C2 = [Char]((Get-Random(35)) + 65)

$C3 = [Char]((Get-Random(35)) + 65)

$C4 = [Char]((Get-Random(35)) + 65)

$String += "$($C1)$($C2)$($C3)$($C4) "

If ($NewLineIndex -gt 15)

{

$Strgin += "`n"

$NewLineIndex = 0

}

$Name = "E:\PS\Files$($X).txt"

$NewLineIndex++

$String | Out-File -LiteralPath $Name

}

Executing this code will generate a lot of files, but this will also help make more of a visual impact with this demonstration. Once this code has executed, we need to install the data deduplcation

Install-WIndowsFeature FS-Data-Deduplication

Once this feature is installed, you need to enable this feature on the volume that is holding your data. In this case, it is the E: drive.

Enable-DedupVolume –Volume E:

Data deduplication will only work when scheduled and on data that is at least 5 days old. To make this demo work, we need to set the age requirment to 0 days.

Set-DedupVolume –Volume E: –MinimumFileAgeDays 0

Now we can start a deduplication. To see our space savings:

Get-DedupStatus –Volume E:

Now we can start the deduplication.

You can check the status of the deduplication job:

And now to see what we got back:

This may not seem like a lot of savings for 10,000 files, but then again these were small files for the most part. You results will vary. In the end, this could be used as a tactic to free up space on hard drives that are critically short on space. Also take a look at the File Server Resource Manager for more tools to help identify data that may be able to be moved to offline storage.

Comments

Sticky Key problem between Windows Server 2012 and LogMeIn

This week I instructed my first class using Windows Server 2012 accessed via LogMeIn and discovered a Sticky Key problem every time you press the Shift key. Here is my solution to resolve this. First off, in the Preferences of LogMeIn for the connection to the Windows Server, click General . Change the Keyboard and mouse priority to Host side user and click Apply at the bottom. On the Windows 2012 server, open the Control Panel – Ease of Access – Change how your keyboard works . Uncheck Turn on Sticky Keys . Click Set up Sticky Keys . Uncheck Turn on Sticky Keys when SHIFT is pressed five times . Click OK twice. If you are using Windows Server 2012 as a Hyper-V host, you will need to redo the Easy of Use settings on each guest operating system in order to avoid the Sticky Key Problem. Updated Information: March 20, 2013 If you continue to have problems, Uncheck Turn on Filter Keys .

With the AD Recycle Bin Turned on, What Happens when you Create a User Account with a Password that does not meet the Password Policy?

This was an interesting observation from one of my Windows Server 2012 classes. While working with the AD Recycle bin in a lab, one of my students discovered some interesting accounts that were created. When he created user accounts that did not meet password complexity requirements, an account is temporarily made and then deleted. When a new password is provided that meets the password requirements, then a new account is made. We discovered this in two places. First off in the Active Directory Administrative Center. This is what caused the initial confusion. Take a look. This is in the Deleted Objects OU. You can see multiple deleted accounts for Test2 and one for Test3. Test3 is a valid, functioning user account. Using the PowerShell command Get-ADObject –IncludeDeletedObjects –Filter * –Properties ObjectSID we can see that indeed, two accounts were created, with one of them deleted. Notice the RID portion of the SID is different. ...

Where did a User’s Account Get Locked Out?

Updated: May 15, 2015 When this article was originally published, two extra carriage returns were add causing the code to malfunction. The code below is correct. My client for this week’s PowerShell class had a really interesting question. They needed to know where an account is being locked out at. OK, interesting. Apparently users hop around clients and forget to log off, leading to eventual lock out of their accounts. The accounts can be unlocked, but are then relocked after Active Directory replication. This problem is solved in two parts. The first one is to modify the event auditing on the network. The second part is resolved with PowerShell. The first part involves creating a group policy that will encompass your Domain Controllers. In this GPO, make these changes. Expand Computer Configuration \ Policies \ Windows Settings \ Security Settings \ Advanced Audit Policy Configuration \ Audit Policies \ Account Management Double click User Account Management C...

Jason Yoder, MCT

Search This Blog