backing up a website
Web Server forum
Back To The Forum Home!Search!Private Messaging System

Web Server Talk Web Server Talk > Unix and Linux reviews > Free Unix support > Unix administration > backing up a website




  Last Thread   Next Thread Next
  Show Printable Version Email this Page Subscribe to this Thread      Post New Thread    Post A Reply      

    backing up a website  
droid


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
11-05-07 06:28 PM

I'm trying to backup up my website using wget.

wget -mirror -w 3 -p -P $HOME/MyWebBak [url]ftp://username:password@ftp.mydomain.com[/u
rl]

This produces $HOME/MyWebBak/index.html very quickly - too quickly.

When I point my browser to $HOME/MyWebBak/index.html, it appears to be
a mirror immage of my website filesystem, but the files have no
content.

Is wget the tool I should be using for a modest ( <5GB) website?

If yes, what should my command line be?

If no, what OSS software should I turn to (using OpenSUSE 10.2, KDE)?






[ Post a follow-up to this message ]



    Re: backing up a website  
Sylvain Robitaille


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
11-05-07 06:28 PM

droid wrote:

> Is wget the tool I should be using for a modest ( <5GB) website?

Ssh access ("scp -r ...." or "ssh ${remote} tar ...") would certainly
be preferable, but I know that not all web service providers accomodate
Ssh access.

If you're backing up by recursive ftp, I think you'll probably have
better success with ncftp ("ncftpget", specifically).

I hope that helps ...

--
----------------------------------------------------------------------
Sylvain Robitaille                              syl@alcor.concordia.ca

Systems and Network analyst                       Concordia University
Instructional & Information Technology        Montreal, Quebec, Canada
----------------------------------------------------------------------





[ Post a follow-up to this message ]



    Re: backing up a website  
droid


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
11-05-07 06:28 PM

On Nov 5, 12:29 pm, Sylvain Robitaille <s...@alcor.concordia.ca>
wrote:
> droid wrote: 
>
> Ssh access ("scp -r ...." or "ssh ${remote} tar ...") would certainly
> be preferable, but I know that not all web service providers accomodate
> Ssh access.
>
> If you're backing up by recursive ftp, I think you'll probably have
> better success with ncftp ("ncftpget", specifically).
>
> I hope that helps ...
>

GoDaddy doesn't permit ssh on shared hosted accounts.  Also, if I ftp
in with Konqueror and try to copy a directory (I assume it uses
mget) ,
it stops with a "too many connections" error.

I hadn't heard of ncftp, I'll have a look at it.   Many sources advise
wget,
but I'm sure I'm not using it right.






[ Post a follow-up to this message ]



    Re: backing up a website  
Dave Hinz


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
11-06-07 12:25 AM

On Mon, 05 Nov 2007 17:45:13 -0000, droid <jshowalter@gmail.com> wrote:
>
> GoDaddy doesn't permit ssh on shared hosted accounts.  Also, if I ftp
> in with Konqueror and try to copy a directory (I assume it uses
> mget) ,
> it stops with a "too many connections" error.

I had that problem with dotster, switched over to dreamhost.  If you
want a discount I can send you a referral code.

> I hadn't heard of ncftp, I'll have a look at it.   Many sources advise
> wget,
> but I'm sure I'm not using it right.

didn't read the whole thread but, did you try wget -r ?

Dave






[ Post a follow-up to this message ]



    Re: backing up a website  
Michael Heiming


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
11-06-07 12:46 PM

In comp.unix.admin Dave Hinz <DaveHinz@gmail.com>:
> On Mon, 05 Nov 2007 17:45:13 -0000, droid <jshowalter@gmail.com> wrote:
 
[vbcol=seagreen]
> I had that problem with dotster, switched over to dreamhost.  If you
> want a discount I can send you a referral code.
 
[vbcol=seagreen]
> didn't read the whole thread but, did you try wget -r ?

w3mir and lftp also have excellent http mirror capabilities.

--
Michael Heiming (X-PGP-Sig > GPG-Key ID: EDD27B94)
mail: echo zvpunry@urvzvat.qr | PERL -pe 'y/a-z/n-za-m/'
#bofh excuse 432: Borg nanites have infested the server





[ Post a follow-up to this message ]



    Re: backing up a website  
Jim Showalter


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
11-09-07 06:23 PM

Dave Hinz wrote:
>
> I had that problem with dotster, switched over to dreamhost.  If you
> want a discount I can send you a referral code.
>

Please do.  I checked them out at http://www.dreamhost.com/hosting.html
and they sound awesome!

>
> didn't read the whole thread but, did you try wget -r ?
>

Yes, it seems to be working fine with -r.  But everyone is advising
against wget, recommending ncft (or ncftpget), w3mir, lftp and FTPsync
instead.


droid
--
Command, n.:
Statement presented by a human and accepted by a computer in
such a manner as to make the human feel as if he is in control.





[ Post a follow-up to this message ]



    Sponsored Links  




 





   All times are GMT. The time now is 06:27 PM.      Post New Thread    Post A Reply      
  Last Thread   Next Thread Next


Most Popular forums 

Forum Jump:
Rate This Thread:

Forum Rules:
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is OFF
vB code is ON
Smilies are ON
[IMG] code is OFF
 
Medical and Health forum | Computer Games Reviews | Graphics design forum

Back To The Top
Home | Usercp | Faq | Register