Announcement

Collapse
No announcement yet.

Data Deduplication

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Data Deduplication

    Hi everyone,
    I am having trouble to experience data deduplication in saving storage space.
    I basically created a virtual server, Windows Server 2012 R2 and only has Data deduplication enabled on the server roles/features. An extra virtual SCSI disk 5GB and set it as K: volume, two .exe files in the volume taking rougly 1GB of space.



    When I run the data deduplication task and the job processed in less than 10 seconds.
    What have I done wrong?
    Thanks guys

  • #2
    Re: Data Deduplication

    Are the exe files the same files?

    Comment


    • #3
      Re: Data Deduplication

      Hi,

      The files are same, all .iso files. Double checked they are in the supported list.

      Just created a Storage Pool, a virtual disk, make it as a volume and put loads of .iso files in the volume but still no luck!

      30GB of virtual SCSI disk
      Used space: 15GB of .iso files

      Windows Server 2012 R2

      Comment


      • #4
        Re: Data Deduplication

        Ok stop the bus.

        In your first post you say they are executable files.

        On the second they are ISO files. What are they?

        Are they identical files located in a different folder?

        Comment


        • #5
          Re: Data Deduplication

          Have you configured dedup properly?

          I basically created a virtual server, Windows Server 2012 R2 and only has Data deduplication enabled on the server roles/features.
          This doesn't mean it is actually configured properly.

          Its been a while since i've done it and configured it and i don't have a system available to test at the moment but this technet article should help

          https://technet.microsoft.com/en-au/.../hh831434.aspx

          Comment


          • #6
            Re: Data Deduplication

            Hey, thanks for the speedy reply.

            I am trying different things now. Sorry, forget about the .exe files as I have deleted the volume and now I am using a bigger storage (30GB) and with bigger files to see if it will make any difference, but nope

            Currently I've got 4 identical .iso (Windows Server 2012 R2) and all located in the root directory of the volume (K

            Comment


            • #7
              Re: Data Deduplication

              Originally posted by wullieb1 View Post
              Have you configured dedup properly?

              This doesn't mean it is actually configured properly.

              Its been a while since i've done it and configured it and i don't have a system available to test at the moment but this technet article should help
              Hi,

              I have followed the instruction/step by step to configure the server, have used PowerShell and Server Manager to configure Data Deduplication.

              The only thing I can think of is, I am doing this in VMware workstation environment...
              Last edited by biggles77; 13th February 2015, 16:04. Reason: Add [/quote] to fix the quote

              Comment


              • #8
                Re: Data Deduplication

                VMware would have nothing to do with it. It just provides the "hardware" to emulate a system.

                I don't have time tonight, it 930pm here, to spool up a VM and test but if i get a chance tomorrow i will. Be interesting to see if i get the same results.

                Comment


                • #9
                  Re: Data Deduplication

                  The virtual server mostly set it up as default.

                  Installed the server with 2012 R2 image from Microsoft site (Not some dodgy one ).

                  Spec:
                  2 vCPU
                  4GB RAM
                  15 GB SCSI (C: - Boot disk)
                  30GB SCSI (K: - Data Drive)
                  All settings are default

                  Windows Server - new server, apart from data deduplication service is enabled.

                  It's really odd... I have visited different blogs and tutorial sites and they have pretty much the same information on how to set this up, but my server just dones't perform what it's told lol

                  Cheers, looking forward to your result!

                  PS:
                  Last edited by kket; 13th February 2015, 13:13.

                  Comment


                  • #10
                    Re: Data Deduplication

                    Can anyone give this a try? It will only take about 15-20 minutes from enabling the feature, transfer some files and test it

                    Thanks!

                    Comment


                    • #11
                      Re: Data Deduplication

                      Ok i've setup a Server 2012 R2 server and added the DeDup feature.

                      Created a new drive and formatted it.
                      Right clicked it and enabled DeDup as General purpose file server.
                      Set the file older thatn to 0 days
                      Clicked on the Set Dedup schedule
                      Enabled background deduplication and clicked on Ok.

                      Opened PowerShell as an administrator and ran
                      Start-DedupJob –Type Optimization –Volume D:

                      Checked the status
                      Get-DedupStatus

                      Checked the job
                      Get-DedupJob

                      Now my files are 6.26MB on the disk.
                      Attached Files

                      Comment


                      • #12
                        Re: Data Deduplication

                        I know what was wrong..

                        I didn't set the files older "0" and the default was set to "3" !

                        Thanks your the man!!!

                        Just re-read some more info on TechNet and found this...

                        "If you set MinimumFileAgeDays to 0, deduplication will process all files, regardless of their age. This is suitable for a test environment, where you want to exercise maximum deduplication. In a production environment, however, it is preferable to wait for a number of days (the default is three days in Windows Server 2012 R2 and five days in Windows Server 2012), because files tend to change a lot for a brief period of time before the change rate slows. This allows for the most efficient use of your server resources."

                        Comment


                        • #13
                          Re: Data Deduplication

                          No problem. Glad it worked.

                          Comment

                          Working...
                          X