performance degradation backing up small files
Web Server forum
Back To The Forum Home!Search!Private Messaging System

Web Server Talk Web Server Talk > WebserverTalk Community > Data Storage > performance degradation backing up small files




  Last Thread   Next Thread Next
  Show Printable Version Email this Page Subscribe to this Thread      Post New Thread    Post A Reply      

    performance degradation backing up small files  
alan


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
05-30-04 04:11 PM

Has anyone experienced performance degradation when backing up large
volumes of files from a NAS array? I am researching complaints that
backing up large volumes of small files (<128k)results in a noticeable
performance drop. One suggested solution was to segregate small files
and back them up over the LAN rather than the SAN. Does this make
sense?

Thanks,
Alan





[ Post a follow-up to this message ]



    Re: performance degradation backing up small files  
Rob Turk


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
05-30-04 04:11 PM

"alan" <alan@radding.net> wrote in message
news:2ed7311a.0404261323.53fa393@posting.google.com...
> Has anyone experienced performance degradation when backing up large
> volumes of files from a NAS array? I am researching complaints that
> backing up large volumes of small files (<128k)results in a noticeable
> performance drop. One suggested solution was to segregate small files
> and back them up over the LAN rather than the SAN. Does this make
> sense?
>
> Thanks,
> Alan

First step is to find out where the bottleneck is. With large numbers of
small files, maybe the disks are overwhelmed by seek requests. More often
the backup software has a bottleneck keeping track of all those small
transactions in the index database.

Measure disk I/O on the NAS, and on the backup server. Find out where the
bottleneck is. Once you find that out, it's time to talk about possible
fixes.

Rob







[ Post a follow-up to this message ]



    Re: performance degradation backing up small files  
Al Dykes


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
05-30-04 04:11 PM

In article <2ed7311a.0404261323.53fa393@posting.google.com>,
alan <alan@radding.net> wrote:
>Has anyone experienced performance degradation when backing up large
>volumes of files from a NAS array? I am researching complaints that
>backing up large volumes of small files (<128k)results in a noticeable
>performance drop. One suggested solution was to segregate small files
>and back them up over the LAN rather than the SAN. Does this make
>sense?
>
>Thanks,
>Alan


Is this thru an ethernet switch ?  FWIW I once saw a _very_ strange
problem that sort of fit your description.  After eliminating lots of
things, I sort of narrowed it down to the switch (an otherwise
excellent HP procurve box in use for a year.) A call to HP support
told me quickly that it was a "known problem" and that I should reboot
the swicth. If the problem reoccured there was a microcode update
avaiable.

FWIW

--
Al Dykes
-----------
adykes  at p a n i x . c o m





[ Post a follow-up to this message ]



    Sponsored Links  




 





   All times are GMT. The time now is 04:03 AM.      Post New Thread    Post A Reply      
  Last Thread   Next Thread Next


Most Popular forums 

Forum Jump:
Rate This Thread:

Forum Rules:
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is OFF
vB code is ON
Smilies are ON
[IMG] code is OFF
 
Medical and Health forum | Computer Games Reviews | Graphics design forum

Back To The Top
Home | Usercp | Faq | Register