… how to safely update the system (regardless of how far out of date) reliably. …

Let's assume that PkgBase is the way forward.

<https://alpha.pkgbase.live/> and so on.

https://lists.freebsd.org/mailman/listinfo/freebsd-pkgbase

In addition to the list, there's sometimes discussion of PkgBase in IRC for FreeBSD.

Retrospective (2018–2019)



 
Can it tie in to a better transport method? (i.e. bittorrent (+extra validation))

freebsd-update is slow and then the mirrors (incl pkg) are also very slow in NZ.

When I downloaded the ~90G of all 13-RELEASE torrents to seed that came down at ~20MB/s (bottleneck being by my wifi).

Downloads freebsd-update/pkg generally maxes at ~300KB/s for download, but most often at ~120KB/s.

So a faster delivery and a better/faster update tool is win win. Keeping the current way for those that need that too, say with sysrc.
 
freebsd-update is slow

This being the first weekend following announcement of 13.0-RELEASE, I should expect some slowness.

Why is freebsd-update so horrible slow?

and then the mirrors (incl pkg) are also very slow in NZ. …

 
It's faster than Kenya so be happy? At any given time, not just major release, the mirrors are slow. Compared to available usable bandwidth (e.g. mirror: 120KBps vs usable: 20MBps), which is why thinking about the transport would be beneficial for NZ & Kenya & Everyone.

freebsd-update is slow, period. It is simply a very slow process regardless of when you perform your upgrade, or if it is a minor or major version.
 
You wrote "… mirrors (incl pkg) are also very slow …", I linked to a recent topic entitled "pkg upgrade slow".

It's faster than Kenya so be happy?

No, but slowness of pkg upgrade might be discussed in the pkg upgrade slow topic.
 
Ah, thanks. I'm all for holistic. I might watch the 2019 video later today (I'm on holiday for a few days).

… thought it was "very soon" tm. …

It does work in that (for example) I used one of the base system package sets at <https://alpha.pkgbase.live/#package-sets> to perform an upgrade:
  • from 13.0-RC5
  • to 13.0-RELEASE
– in a disposable virtual machine. Upgrade succeeded.

Alpha

Re: <https://alpha.pkgbase.live/howto/bootstrap.html#pkgsave> if I understand correctly, it should be possible to (for example):

Code:
mv /etc/master.passwd.pkgsave /etc/master.passwd
mv /etc/group.pkgsave /etc/group
/usr/sbin/pwd_mkdb -p /etc/master.passwd

– however, this will be less than pleasing if your users are mysteriously missing from /etc/master.passwd.pkgsave. Keyword: clobber.

Part of my success – without the user-related clobber – probably involved straying from the <https://alpha.pkgbase.live/howto/bootstrap.html#setup> part of the routine. I should discuss the experiment in private before sharing details here.

Documentation

Omission of <https://wiki.freebsd.org/PkgBase> from the opening post was intentional. <https://wiki.freebsd.org/action/info/PkgBase?action=info> my comment "… This page will benefit for a non-trivial re-write to reflect ongoing work in and around the FreeBSD community." is a polite way of saying that the page is horribly outdated.

I'm an editor, but I'm not the person to pull the page into shape; I don't have the big picture
 
I'll give it a try at some point. I remember looking at this wiki page a while ago and thinking the project was stagnant but PkgBase is definitely an important optional improvement going forward and if proven over time could become default. It also makes sense that pkg users have OS updates be handled via packages but that doesn't mean the traditional way needs to go away either - both can be used to verify the same outcome occurred (else a bug exists somewhere).

Plus, to re-iterate better delivery could be added on too i.e. torrent / CDN etc
 
Hey... I think the posters in this thread are not considering the fact that this very well may have to do with network bandwidth in Kenya and NZ (New Zealand, I assume?) you gotta pick a FreeBSD mirror that is closer by. I know that FreeBSD offers scripts to do IP resolving and do it for you, but they also provide a list of mirrors and what they host. How fast those mirrors are - that's really out of FreeBSD's hands.

FreeBSD does offer their .iso files over bittorrent.... Now, if pkgbase.live used scripts that roll an iso that is later distributed via bittorrent and then slurped in/processed by a client machine - now that would be something.
 
… a separate utility that allows one to see what would be downloaded using freebsd-update fetch without downloading? …

When PkgBase becomes a norm, there'll be something like this:

pkg upgrade -n -r FreeBSD-base

For example:

Code:
root@mowa219-gjp4-8570p-freebsd:~ # pkg upgrade -n -r FreeBSD-base
Updating FreeBSD-base repository catalogue...
Fetching meta.conf: 100%    164 B   0.2kB/s    00:01   
pkg: https://alpha.pkgbase.live/current/FreeBSD:14:amd64/latest/packagesite.pkg: Not Found
Fetching packagesite.tzst: 100%   34 KiB  34.7kB/s    00:01   
Processing entries: 100%
The provides database is up-to-date.
FreeBSD-base repository update completed. 355 packages processed.
All repositories are up to date.
Checking for upgrades (1 candidates): 100%
Processing candidates (1 candidates): 100%
The following 1 package(s) will be affected (of 0 checked):

Installed packages to be UPGRADED:
        FreeBSD-clibs: 14.snap20210513182414 -> 14.snap20211201183053 [FreeBSD-base]

Number of packages to be upgraded: 1

4 MiB to be downloaded.
root@mowa219-gjp4-8570p-freebsd:~ #
 
Packaging and PkgBase, roadmapped:

1638584954433.png




 
Package base seemed like a good idea then. If it's really that difficult with not proportional benefit, it may be better to put what they learned from that into something else. Here's the individual PDF of that article: https://freebsdfoundation.org/wp-content/uploads/2022/03/JanFeb_letters.pdf.

A vanguard subset of the ports tree, that's like an extension of base where each distribution set is optional, would be better.
That PDF is mostly humorous stuff, but it does make good points about the never-resolved dependency hell. Along the same lines, I think that KDE should be upgradeable independently of the rest of the ports tree, and have been putting in some effort into that idea: Thread poudriere-bulk-not-finding-updates-to-the-tree.83134/. Post #51 in that thread has a possible solution that I still need to verify.
 
I think that KDE should be upgradeable independently of the rest of the ports tree, and have been putting in some effort into that idea: Thread poudriere-bulk-not-finding-updates-to-the-tree.83134/. Post #51 in that thread has a possible solution that I still need to verify.
KDE, Gnome, MATE and XFCE desktops each need their own separate repository on top of the main repository. These repositories would work together and the main repository would contains dependencies for the repository layered on top of it. Common applications and libraries that aren't specific to any of these desktops, but may be heavily associated or named along with these desktops, can be in the main repository. These desktops can be hosted on FreeBSD, but they really need their own portstree that works on top of the main portstree. These projects are too large, and their excessive dependencies mix up with other basic dependencies.

I didn't see my understanding of that suggestion about KDE in post #51, but more may have been on your mind along the lines of what you wrote there. A lot of port suites require looking into /usr/ports/Mk/Uses/.
 
Back
Top