Solved [Solved] Downloading entire PKGNG repo

[kpedersen]

Hi,

I am looking to upgrade my home machine from 9.2 RELEASE to 10.0 RELEASE.
Since I live in England, my internet connection is crap and I need to download all the packages from work. With the previous package system, I just grabbed all the packages from FTP and put them on my usb hard drive. Now that PKGNG is a little more fiddly and Linux like, is there still a way to do this? Perhaps something like yum-downloader on Fedora Linux?

I cannot seem to do a whole lot with the package site: http://pkg.freebsd.org/

Any suggestions would be appreciated.

 

[SirDice]

Re: Downloading entire PKGNG repo

You need to grab the packages from http://pkg.freebsd.org/freebsd:10:x86:64/latest/ (assuming you're on amd64) the 'homepage' of http://pkg.freebsd.org is rather empty. You should be able to do the same thing as with the old packages. You can install local packages using pkg-add(8) instead of pkg-install(8).

 

[kpedersen]

Re: Downloading entire PKGNG repo

Ah apologies, I didn't explain that clearly. Since the packages found at http://pkg.freebsd.org/freebsd:10:x86:64/latest/ are not provided by ftp, is there a way I can download them all in one batch rather than one by one in the web browser?
Surely some sort of web crawler is a bit of a hacky solution here?

 

[deflected]

Re: Downloading entire PKGNG repo

@kpedersen,

Try with:
wget --no-clobber --convert-links --random-wait -r -p -E -e robots=off -U mozilla [url=http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/]http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/[/url]

 

[Beastie]

Re: Downloading entire PKGNG repo

Can't pkg-fetch(8) with option -a work for what you want to do?

What @deflected proposed can also be done with fetch(1) and a few lines of scripting, if you don't want to use third-party tools. Just "save" the directory in your web browser and append the url to every line. Then run fetch(1) in a loop.

 

[kpedersen]

Re: Downloading entire PKGNG repo

Cool, cheers.

The wget solution has worked great. I guess a problem with pkg-fetch(8) is that I would have to bring my laptop running 10-RELEASE into work to use that.