Major and Minor Version Upgrades offline

S

scryptkiddy

Hey all,

Trying to update a system that is not connected to internet from 8.2-RELEASE to 8.3-RELEASE.

On the internet connected machines, there are no problems. I followed the 25.2.3 section of the handbook, boom, all good. :e

But on the system that is not internet connected, I was a bit stumped.
I did a few searches, but was a bit lost on some of the hits on how to do this. One thread seemed to be really close to what I'm trying do.

wblock had a response(#4), but said it was (untested), and I also noticed fronclynne's response (#5) but was a bit confused where to start (I'm new at FreeBSD obviously) and how to do that exactly.

Is there a section in the handbook for doing offline upgrades, or can someone help me understand their postings (if they are correct) in this situation? Would appreciate it.

SK
 
On the online machine check out a full source tree for 8.3-RELEASE (releng/8.3). Tar /usr/src/ and copy it to the offline machine. Build and install world as normal.
 
If you've /obj /src on a thumbdrive, you can mount -o union (or unionfs) it to /usr and the two directories would be there to installworld from... won't always work but usually does. (rsync ... --bwlimit=1000 (see other posts) is useful for copying to the thumbdrive without corrupting it ( and can be tested first with just a subdirectory within /usr/src )
 
Hey all,

@SirDice - Your reply has me reading a lot on the CVS vs Subversion, since (I'm assuming) Subversion is what I need to use to "check out a full source tree". So I read up on Synchronizing Source in Handbook (25.6).

I had only used portsnap to update my ports tree, along with portinstall / portupgrade to install and upgrade ports, along with freebsd-update to update the kernel. I have never known I could check out a full source tree, or even why I would need to (this a total noob admission I'm sure). :\

Anyhow, according to the Handbook (3.2.1) I can check out a source tree using:
# svn checkout [url=svn+ssh://svn.freebsd.org/base/head]svn+ssh://svn.freebsd.org/base/head[/url] /usr/src
then tar it up and copy it over to the offline machine.

After that, I'm going to follow 25.7 Rebuilding “world” section of Handbook.

Let me know if I'm on the right track, and I can let everyone know how it worked out.

SK

@jb_fvwm2 - sorry amigo, thumb drives not an option right now, system is not close by.
 
Last edited by a moderator:
scryptkiddy said:
Hey all,

@SirDice - Your reply has me reading a lot on the CVS vs Subversion, since (I'm assuming) Subversion is what I need to use to "check out a full source tree". So I read up on Synchronizing Source in Handbook (25.6).

...

Anyhow, according to the Handbook (3.2.1) I can check out a source tree using:
# svn checkout [url=svn+ssh://svn.freebsd.org/base/head]svn+ssh://svn.freebsd.org/base/head[/url] /usr/src
then tar it up and copy it over to the offline machine.
Click to expand...

That's not quite the right command. Only someone with a user account on the server can use svn+ssh. And "head", also called -CURRENT, or the bleeding edge development version, is not recommended unless you are a developer. The Using Subversion section shows a bit more.

Please point me to where you saw that example, because it should be updated.
 
Last edited by a moderator:
Use freebsd-update to download the release you want. Then copy /var/db/freebsd-update to the offline machine. And use freebsd-update to install that version on the offline machine.

IOW, you fetch on the machine with Internet access. Sneaker-net the bits over to the offline machine. Then install on the offline machine.
 
@@wblock I misspoke, it was not the Handbook, but an article on the freebsd website. It was formatted like the Handbook, so I thought it was part of it. Scroll down to the 3.2.1 section, that's where I got it from. Let me know what the right command is if that's not it (or is it in the link you gave me?).

@phoenix I tried that as my first go round, meaning I brought over all of the /var/db/freebsd-update directory to the non internet connected box. When I brought it over to that box, FreeBSD would not allow me to run freebsd-update without errors. It gave an error (I wish I would have wrote it down), that basically stated that there "were no updates to apply" or something to that effect.So I reverted the /var/db/freebsd-update directory to the backup that I made prior to starting that attempt.

Sounds like I need the correct svn command (if you have please provide) then I can check out, copy, and bring over the new source tree to the offline box and test the build world section IAW the Handbook.

Let me know if I'm on the right track. Appreciate the replies.

SK
 
Last edited by a moderator:
scryptkiddy said:
@wblock I misspoke, it was not the Handbook, but an article on the freebsd website. It was formatted like the Handbook, so I thought it was part of it. Scroll down to the 3.2.1 section, thats where I got it from.
Let me know what the right command is if thats not it (or is it in the link you gave me?).
Click to expand...

Yes, that was the Committer's Guide.

To check out FreeBSD 8.3-RELEASE:
Code: 
# mv /usr/src /usr/src.old
# svn checkout https://svn0.us-west.FreeBSD.org/base/releng/8.3 /usr/src

In the first step, /usr/src can be deleted if you don't have any customizations you want to save. Either way, make sure /usr/src does not exist before the checkout.

The second line uses the western SVN mirror. Depending on where you are, the eastern mirror might be faster.
 
Ahh, okay. Am I to assume the Committer's Guide is not authoritative and more informational from this point on, or is that something you are going to update? Just curious for future reference...

Back to business though, after I check out the source tree using SVN, I would tar up the /usr/src directory on the online box and move it over to the non internet connected box corrrect? And I'm assuming I would also need to ensure that the /usr/src directory does not exist on the non internet connected box as well (tar will overwrite it anyway, but just wondering).

Seems logical, but I hate assuming anything.

SK
 
The Committer's Guide is okay, but it's for committers, people who can directly modify FreeBSD source, ports, or docs. The example it uses is somewhat correct for that, although it's been recommended that people use the mirrors rather than just svn.freebsd.org, which could change.

Once you have the /usr/src directory, yes, copy it to the system to be upgraded. The .svn subdirectory is not needed, and skipping it will save a fair amount of space. To avoid old files, remove the destination /usr/src first.
 
Hmm, well have been troubleshooting the error if anyone is wondering whats going on.

So after moving the tar of /usr/src from the online box to the non internet connected box, I mv'd the /usr/src to /usr/src.old , then extracted the tarball in the /usr directory.

Everything looked correct under the new /usr/src , so I ran [cmd=]freebsd-update install[/cmd] and received the following error:

Code: 
[CMD=" "]#freebsd-update install[/CMD]
No updates are available to install. 
Run '/usr/sbin/freebsd-update fetch' first.

Not sure what that really means since the /usr/src that I uploaded was fetched on the online box, so it should be the latest already.

Uname of online box:
8.3-RELEASE-p3
Uname of non internet connected box:
8.2-RELEASE-p3

So I'm assuming I missed a step on the non internet connected box, or that something besides /usr/src is required to bring over.

Let me know where I went wrong.

SK
 
Just thought of something. Do I need to bring over /usr/src/ AND /var/db/freebsd-update?

Maybe that's what I missed. Let me know.

SK
 
I'm about to execute, been doing some reading on the build world procedurein the handbook.

My question is this non internet box is not close by so booting into single user mode remotely is not feasible unless I have a DRAC connection (which I don't). :(

Not sure if I'm dead in the water, but trying to figure out if going to single user mode is absolutely necessary....or just recommended. This box is a test box of sorts, so I can try it, and / or shut down services if need be. But wanted to ask.

SK
 
Yeah, I kinda figured. After my post I saw this too in the build world procedure in the link from my post above:

Upgrades from one release of the same FreeBSD branch to a more recent release of the same branch, such as from 9.0 to 9.1, may not need this procedure since it is less likely to run into serious mismatches between compiler, kernel, userland, and configuration files. The approach of make world followed by building and installing a new kernel might work well enough for minor updates.
Click to expand...

Since I'm going from 8.2 to 8.3 that applies. So based on the above from the handbook (and the link you sent me) its just:
Code: 
# make buildworld
# make kernel
# make installworld
# mergemaster -Ui
# shutdown -r now
/* Not in handbook, but might need? */
# cd /usr/src
# make check-old

I'm a little nervous about the last command, the link sent from wonkity says:
If old files are found, use the delete-old and delete-old-libs targets to remove them. Programs that are still using old libraries will be broken until they have been recompiled.
Click to expand...

So I'm assuming that # make check-old will give me a report, and let me know which binaries / ports / packages I'll have to recompile IF I choose to delete them.

Fun stuff though, I'm currently on # make buildworld, its been running for like 15+ minutes. I suppose that if I had not brought over the .svn directories it would have been quicker? :\

I'll let this run, gonna look at this after the weekend, and I'll continue to follow up with status and / or questions if they come up, appreciate help thus far @wblock@.

SK
 
Last edited by a moderator:
So I'm assuming that # make check-old will give me a report, and let me know which binaries / ports / packages I'll have to recompile IF I choose to delete them.
Click to expand...

It would be nice, but no, it does not. Such a report is possible, I think, but it would take a very long time to run.

...Fun stuff though, I'm currently on # make buildworld, its been running for like 15+ minutes. I suppose that if I had not brought over the .svn directories it would have been quicker? :\
Click to expand...

No, the .svn directory is not used by the build. As far as fifteen minutes, you're compiling the entire userland from source. Yes, it will take a while. Sometimes hours on a slow machine.

There are some potential pitfalls in the process. Using mergemaster(8) is one. Read the man page, and do not blindly tell it to merge critical files like /etc/master.passwd or /etc/group.

Have you made a full backup?
 
Yes, I created a backup using # dd to create a dump of each partition. I'm pretty familiar with it as well as # restore. I'll probably make a local copy of /etc/ files such as rc.conf passwd fstab, and others that I think I might need if # mergemaster is as potentially dangerous as it sounds.

This morning my (Windoze) computer seems to have been rebooted by a patch, I'm assuming my # make kernel finished though since it would be executing on the server anyway and has been on all weekend. I'm not sure if there is a way to check, but it should be okay to continue on to # make installworld next. I'll be reading up more on # mergemaster while it is executing that command.

SK
 
Progress, but a hiccup along the way that I need a bit more information on.

I tried to execute # make installworld, however, I received an error:

Code: 
mtree: line 73: unknown user uucp
*** Error code 1

Stop in /usr/src.

I do recall removing the uucp user a while back (based on security). It was an account that I saw as unneccessary to run the OS, however it was (and seems still is) required to build the OS. At the time, I was only updating FreeBSD on internet connected boxes, so I assumed it safe to remove the user by simply commenting the user out of /etc/passwd via # vipw since I was using # freebsd-update only.

So I uncommented out the user in /etc/passwd, and reran the # make installworld and its (still) running. :e

But I would like to ask for some information on the # uucp user (not the binary). What I stated above is the length of my knowledge on the user, but any links or keen information on this user (as it applies to this thread) would be helpful.

SK
 
Okay

Rebooted, [CMD=""]uname -a[/CMD] now shows 8.3-RELEASE-p6, nice! :e

One items that I have to address:
I ran the rest of the commands on this link that you posted to check for any old libraries. Here is the result.
Code: 
#cd /usr/src/
#make check-old
>>>> Checking for old files
>>>> Checking for old libraries
/lib/libcrypt.so.4
/lib/libreadline.so.7
/lib/libz.so.4
>>>> Checking for old directories
To remove old files and directories run 'make delete-old'.
To remove old librarires run 'make delete-old-libs'.

I have seen libcrypt.so.4 before when doing openssl(1) / ssh(1) updates, I think libz.so.4 is the also. So the question is, can I remove those (I will rebuild openssl(1) / ssh(1)), and / or how do I determine what needs to be rebuilt?


SK
 
Don't use dd(1) for backups, it is not good for that. See Backup Options For FreeBSD.

Both openssl(1) and ssh(1) are part of the base and were rebuilt with world. Problems would be if something from ports was linked to the old libraries. That is rare, and I can't recall the last time I saw a problem with that. I would make another backup--maybe just of those libraries--and then remove them and test.
 
Oops, big misprint. :\ I happened to be reading an article on dd(1) and typed it while I was replying to your post. Yes, I use dump(1), and love it too.

As far as the openssl and ssh, I noticed that the packages for those ports were still installed (the latest versions). So I can easily link /usr/bin/ssh (base) to /usr/local/bin/ssh and /usr/bin/openssl (base) to /usr/local/bin/openssl respectively.

Good idea as far as backing up the files before removing, however as far as seeing what breaks that may be difficult. This box has around 140+ ports installed, not sure how I would be able to test except if something in future breaks when using or recompiling occurs.

Thanks again for all the help, now I know.

SK
 
Perhaps I'm installing the ports incorrectly.

On the internet connected box I do the following to update the ports tree, then install the latest port, then create a package to move over to the non-internet connected box, then test:
-Internet connected box
Code: 
#portsnap fetch
#porsnap extract
#portmaster -Bvw openssl
#portmaster -Bvw openssh
#pkg_create -b openssl-1.0.<new>
#pkg_create -b openssh<new>

-After uploading created packages above, on Non Internet connected box:
Code: 
#pkg_create -b openssl-1.0.<old>
#pkg_delete -f openssl-1.0.<old>
#pkg_add openssl-1.0.<new>
#pkg_create -b openssh<old>
#pkg_delete -f openssh<old>
#openssl version
#ssh -V

I usually find that even after this, that the old version of openssl / openssh are still installed under /usr/bin/ssh /usr/bin/openssl, and the new ones are under /usr/local/bin/, so I usually link to ensure only the newest version is used in case the /usr/bin is called instead of the /usr/local/bin.

Thats the only way I learned, if there is a better way please let me know.

SK
 
If a port is supposed to replace base system software, it should have an option for that. Packages will not give a choice for that option, it will have to be set when the package is built.
 
You must log in or register to reply here.
Back
Top