Mirroring CentOS.org
Hello,
I would like to mirror the CentOS.org repository for an offline network. I
don’t need the ISO images, don’t need any i386 stuff, and I think I
probably don’t need any of the source code rpms either. Most of the clients are CentOS 6.x, so I don’t want to download the CentOS 7.x tree yet either
(that will come soon, but separately from this one).
I tried using this command, but it still downloaded all of the i386
sub-folders anyway, and I got about 15 gigs or so of stuff I didn’t want.
wget -m -np –exclude-directories=i386 http://mirror.CentOS.org/CentOS-6/6/
I’m guessing there’s a formatting mistake of some kind in this command. Do you need to specify the excluded sub-folders relative to the top directory you’re downloading from? i.e. rather than “i386”, you’d need to specify
“/CentOS-6/6/updates/i386/”?
FW
4 thoughts on - Mirroring CentOS.org
You probably should start by not mirroring mirror.CentOS.org, but a local mirror:
https://CentOS.org/download/mirrors/
If you plan on regularly mirroring the CentOS repos on that site, please contact them and let them know.
You should also consider using a yum-aware tool like reposync, mrepo or pulp to create your own repos, rather than using ‘wget’. Many repos have rsync:// support, which means you can also use rsync to do this.
In article, Felipe Westfields wrote:
Don’t use wget at all. Use rsync instead, from a mirror that supports it. Here is what I use (in a nightly cron):
# cd /myrepo
# rsync -rltHvz –delete rsync://rsync.mirrorservice.org/mirror.CentOS.org/6/os/i386/ CentOS6/os/i386/
# rsync -rltHvz –delete rsync://rsync.mirrorservice.org/mirror.CentOS.org/6/updates/i386/ CentOS6/updates/i386/
# rsync -rltHvz –delete rsync://rsync.mirrorservice.org/mirror.CentOS.org/6/os/x86_64/ CentOS6/os/x86_64/
# rsync -rltHvz –delete rsync://rsync.mirrorservice.org/mirror.CentOS.org/6/updates/x86_64/ CentOS6/updates/x86_64/
Omit the ones you don’t want.
There are other ideas listed at https://wiki.CentOS.org/HowTos/CreateLocalMirror
Cheers Tony
Ok, that sounds a little more elegant.
Does that delete switch delete those files after download, or does it stop it from downloading at all?
It means “remove files that aren’t on the source”. This would generally be older versions of packages that have been replaced.