Hello All,

I have setup our NAS EMC backup, I am using TSM 7.1.7 define to schedule the backup of NAS C$ so that it should cover all the folder's and sub folders , backup is running extremely slow I have started backup on 31st OCT till now only approx 3 TB backup has been completed total size of NAS is around 17 TB, approx 500 GB data backup is happening only in a day, Need your help to fine tune this so that backup can be completed asap, I have TS3100 Lib with one drive and IBM LTO 4 tapes is there, any other information required pls do let me know.

Thanks

Prem

Hi Guys,

Waiting for your inputs.

Prem

Hello Prem,

Are you running NDMP backup?

Marcel Sampaio Tubini

Partner IT Consultoria em Serviços

11 3636-8989 / 11 99429-7714
marcel@partner-it.com.br

https://goo.gl/3B3UZi

Hello Marcel,

I have extended edition tsm but I am not using NDMP, I have mounted CIFS share on tsm server and in the batch file i have given network shared path to backup.

Prem

If you're not using NDMP, are you at least backing up to a diskpool (which migrates to tape)?

Hello Daniel,

Thanks for the response, backup is going directly into tape, I have a crunch of space that is why not created a diskpool.

Thanks

Prem

Hello Prem,

This is the worse way to run backup of a filesystem with small files. You may try to increase TxnByteLimit  parameter in dsm.opt , but the better solution is to create a disk storage pool.

Thanks!

Marcel Sampaio Tubini

Partner IT Consultoria em Serviços

11 3636-8989 / 11 99429-7714
marcel@partner-it.com.br

https://goo.gl/3B3UZi

Hi,

Thank you for the response , actually I attempted to figure out NDMP first but failed to setup then I tried that option for disk pool i have 17 TB Nas with deduplication enabled on Nas for that much amount space I don't have on SAN or local disk other I have to create small size disk pool and backup in chunk which is again a manual option because I have less space can't go in one go, additionally if I use NDMP will that help if yes how I can setup that I have a confusion to setup NDMP.

Prem

have you ever seen dsmisiMAGS. It is a valid solution to speed up big filer backups:http://www.general-storage.com/

Gerd got there before me. I was going to say, MAGS is the answer. Some more info here: http://tectrade.com/2017/10/27/improve-nas-backup-performance/?bc=8

Given the infrastructure you have at the moment, you should probably be doing NDMP direct to tape, as you have no diskpool. However, NDMP is not really a sustainable solution, plus you can only ever restore the data back to an EMC filer. You are stuck with full and diff schedules, and cumbersome backup and restore jobs.

Ideally, you want to do incremental forever backups, to make the most of TSM, however, you have 2 challenges:

1) You need a diskpool. Backing up little files incrementally direct to tape won't perform well. You just need enough disk for 1 incremental backup though, as a minimum.

2) Doing an incremental backup of CIFS/SMB file shares over the LAN will take hours, and exceed a backup window possibly. That is due to the inventory scan, and has nothing to do with network bandwidth. It will be especially slow if you have thousands or millions of files to scan. This is where you need MAGS, to accelerate the inventory scan process. You can then take advantage of incremental forever backups, complete wihin the backup window, and also have the benefit of being able to restore files to any file server, without it having to be an EMC NAS.

By the way, is this for an EMC VNX or Unity? Not that it matters much.

Hi,

Thanks for the details information according to your input I feel I have no option rather than wait to complete the job once, reason solution which you are referring that will add additional cost which client will not accept as they have recently purchased the TSM, NDMP limitation seems to be okie for me as of now because Diskpool option I don't have, but not able to figure out the NDMP configuration , and I have Emc VNX .

Prem

Without any further investment (be it some disk, MAGS software, or just more LTO4 drives if you use NDMP), you're pretty much stuck with a solution which isn't fit for purpose.

Using NDMP, you would ideally have more than just one LTO4 drive, so that you could at least run more than one NDMP session in parallel (there is a limit on the VNX, 8 I think). But with just one drive, you can't do it any faster.

Have a look for the guide titled "Configuring NDMP Backups on VNX P/N 300-011-830". It covers NDMP configuration on the VNX for a variety of 3rd party backup solutions, including TSM, but to be honest, unless there is something going on at the filer end, it isn't likely to improve.

Maybe at least check what kind of disks are in the VNX. If it is a small array of SATA drives, then may be the filer simply doesn't have the spindles to drive the throughput of the LTO4 drive (NDMP rarely seems to push the drive throughput anyway).

Hello Prem,

I can remember, that you are visiting the ISP Symposium in Cologne this year. Did you see the presentation of Lars Henningsen from General Storage? He told about dsmisiMAGS, a very powerful solution to back up huge Filers in parallel. Now he raised a new version (1.4) with many new features. The Software is available for 30 day trial. For further questions please contact me.