Solved Getting started with poudriere – with latest packages and OpenZFS

Cath O'Deray · Jun 12, 2022

grahamperrin@ said:
I'll post something simplified. …

astyle said:
There is a Poudriere How-To … (from 2013), but still useful …

grahamperrin@ said:
Thanks, what I have in mind should be much shorter.

Sivan! said:
If you have posted an article on Reddit on Poudriere, would be helpful if you could share the link.

As promised: <https://old.reddit.com/r/freebsd/comments/vab4yt/-/>

Sivan! · Jun 12, 2022

grahamperrin, Thank you. Completed all the reddit steps, didn't create anything new that already existed. In the end, these are the errors/messages:

doas pkg install --quiet --yes ports-mgmt/poudriere-devel

Conflicts with the existing packages have been found.
One more solver iteration is needed to resolve them.
You may need to manually remove /usr/local/etc/poudriere.conf if it is no longer needed.

Didn't remove the conf file, went through steps 3,4,5 and made changes if the suggested entries weren't already there. And then,

poudriere ports -c
[00:00:00] Error: The ports tree, default, already exists

poudriere ports -u
[00:00:00] Error: This command requires root or poudriered running

doas poudriere ports -u
[00:00:00] Updating portstree "default" with git+https...fatal: cannot change to '/usr/local/poudriere/ports/default': No such file or directory
[00:00:00] Error: fail

poudriere status

=>> Error: Log path /usr/local/poudriere/data/logs/bulk does not exist.

Q: If I have to create "default" under the directory /usr/local/ports what do I say in the file named default? Or, is this error something to do with poudriere non running?

Thank you.

Cath O'Deray · Jun 12, 2022

Thanks.

Please note, the emphasis here is on getting started – in as few words as possible.

If you already got started, in a different way, and can't remember the path that you chose for a ports tree:

poudriere ports -l

Elsewhere on the spectrum: Poudriere: A complete guide (discussion of a 2021 post by jbodenmann), and so on.

Sivan! · Jun 12, 2022

Thank you

poudriere ports -l

PORTSTREE METHOD TIMESTAMP PATH
HEAD git+https 2022-04-27 08:31:24 /usr/local/poudriere/ports/HEAD
default git+https 2022-04-28 22:25:04 /usr/local/poudriere/ports/default
test null 2022-05-11 01:57:17 /usr/ports

Now going through the link to the complete guide that you have shared

Thank you

Cath O'Deray · Jun 12, 2022

file /usr/local/poudriere/ports/default

Sivan! · Jun 12, 2022

grahamperrin@ said:
file /usr/local/poudriere/ports/default

It is empty.

jbo@ · Jun 12, 2022

Sivan! said:
It is empty.

For some reason you have a ports tree registered at poudriere (hence it shows up with poudriere ports -l) but it doesn't actually exist.
What happens when you run poudriere ports -p default -u?

Sivan! · Jun 12, 2022

jbodenmann said:
poudriere ports -p default -u

[00:00:00] Updating portstree "default" with git+https...fatal: cannot change to '/usr/local/poudriere/ports/default': No such file or directory
[00:00:00] Error: fail

jbo@ · Jun 12, 2022

Not sure what's going on here. I'd try removing the ports tree(s) (using poudriere ports -d -p <tree_name>) and adding it/them again freshly.

Don't forget to backup your ports tree(s) if you have modifications in there that you need to keep around.

Sivan! · Jun 12, 2022

poudriere ports -d -p /usr/local/poudriere/ports/HEAD
poudriere ports -d -p /usr/local/poudriere/ports/default

Is this right?

jbo@ · Jun 12, 2022

Sivan! said:
poudriere ports -d -p /usr/local/poudriere/ports/HEAD
poudriere ports -d -p /usr/local/poudriere/ports/default

Is this right?

The -p parameter expects the name of the ports tree (eg. HEAD and default) - not the path to the ports tree.
Ref: poudriere-ports(8).

Sivan! · Jun 12, 2022

jbodenmann said:
The -p parameter expects the name of the ports tree (eg. HEAD and default) - not the path to the ports tree.
Ref: poudriere-ports(8).

deleted HEAD and default. Now what do I do?

Thank you.

jbo@ · Jun 12, 2022

Sivan! said:
deleted HEAD and default. Now what do I do?

Honestly, I don't exactly know what you're trying to accomplish. I just chimed in because it seemed like you had a non-existing ports tree registered at poudriere.

Assuming that you just want to build the latest packages available, you'd add a ports tree like this:

Code:

poudriere ports -c -m git+https -B main -p default

This will create/register a new ports tree tracking the main branch of the corresponding git repository. That tree will be called default.

Sivan! · Jun 12, 2022

This is what happened:

poudriere ports -c -m git+https -B main -p default

[00:00:00] Error: This command requires root or poudriered running

doas poudriere daemon
doas poudriere ports -c -m git+https -B main -p default

[00:00:00] Creating default fs at /usr/local/poudriere/ports/default... done
[00:00:00] Cloning the ports tree...fatal: unable to access 'https://https://github.com/freebsd/freebsd-ports.git/': Could not resolve host: https [00:00:01] Error: fail
[00:00:01] Error while creating ports tree, cleaning up.

doas poudriere ports -c -m git -B main -p default # tried after removing +https in the command because the previous error showed a
https://https//
error

[00:00:00] Creating default fs at /usr/local/poudriere/ports/default... done
[00:00:00] Cloning the ports tree...fatal: unable to look up https (port 9418) (Name does not resolve)
[00:00:00] Error: fail
[00:00:00] Error while creating ports tree, cleaning up.

Cath O'Deray · Jun 12, 2022

From Getting started …:

poudriere ports -c

– commands such as this do require superuser privileges.

For simplicity, I typically run all poudriere commands as root. (Bad practice? I don't know.)

jbo@ · Jun 12, 2022

Something seems weird in your network setup.
Is your host that's running poudriere able to resolve host names?

eg. what's the output of host freebsd.org?

Sivan! · Jun 12, 2022

poudriere ports -c #as root as grahamperrin@ suggested

[00:00:00] Creating default fs at /usr/local/poudriere/ports/default... done
[00:00:00] Cloning the ports tree...fatal: unable to access 'https://https://github.com/freebsd/freebsd-ports.git/': Could not resolve host: https

The error shows that the github URL looked up is https://https://github.com/freebsd/freebsd-ports.git/ # with a double https://

[00:00:00] Error: fail
[00:00:00] Error while creating ports tree, cleaning up. #same errors

# host freebsd.org

freebsd.org has address 96.47.72.84
freebsd.org has IPv6 address 2610:1c1:1:606c::50:15
freebsd.org mail is handled by 30 mx66.freebsd.org.
freebsd.org mail is handled by 10 mx1.freebsd.org.

jbo@ · Jun 12, 2022

I'm not sure what's going on there. What version of ports-mgmt/poudriere are you using? I assume it's 3.3.7?
Unless I am missing something there is no explicit way to setup the look-up URL for ports in poudriere.conf. However, you may specify it the URL to the git repo explicitly using the -u switch.

Sivan! · Jun 12, 2022

jbodenmann said:
I'm not sure what's going on there. What version of ports-mgmt/poudriere are you using? I assume it's 3.3.7?
Unless I am missing something there is no explicit way to setup the look-up URL for ports in poudriere.conf. However, you may specify it the URL to the git repo explicitly using the -u switch.

poudriere version

poudriere-git-3.3.99.20211130

ports-mgmt/poudriere version

bash: ports-mgmt/poudriere: No such file or directory

cd /usr/ports/ports-mgmt
#found poudriere
/usr/ports/ports-mgmt/poudriere]$ cat distinfo

TIMESTAMP = 1629310335
SHA256 (freebsd-poudriere-3.3.7_GH0.tar.gz) = a85cfeb601455758bcc777182c1ef59e5172f9c2171d66c994e4c00cfac572ee SIZE (freebsd-poudriere-3.3.7_GH0.tar.gz) = 4423394

How do I find out if I have installed more than one instance of Poudriere, such as Poudriere somewhere and a development version of it under some other portstree branch? I went through a few iterations, installing and deinstalling poudriere, switching from ports to pkg and vice versa, which might have mixed up something somewhere. (Not sure.)

Lamia · Jun 13, 2022

grahamperrin@ said:
As promised: <https://old.reddit.com/r/freebsd/comments/vab4yt/-/>

Thanks grahamperrin@.

May I add a few lines for those wanting Poudriere in a jail?
for Ezjail:

Code:

export jail_JAILNAME_parameters="children.max=60 allow.mount=1 allow.mount.devfs=1 allow.mount.procfs=1 allow.mount.linprocfs=1 allow.mount.zfs=1 allow.mount.nullfs=1 allow.mount.fusefs=1 allow.mount.tmpfs=1 allow.raw_sockets
=1 allow.socket_af=1 allow.sysvipc=1 allow.chflags=1 enforce_statfs=1 ip6=inherit ip4=inherit"

And Jail.conf translation is:

Code:

       ........
       ........
       allow.sysvipc = 1;
        enforce_statfs = "2";
        children.max=60;
        allow.mount=1;
        allow.mount.devfs=1;
        allow.mount.procfs=1;
        allow.mount.linprocfs=1;
        allow.mount.zfs=1;
        allow.mount.nullfs=1;
        allow.mount.fusefs=1;
        allow.mount.tmpfs=1;
        allow.raw_sockets=1;
        allow.socket_af=1;
        allow.sysvipc=1;
        allow.chflags=1;
        enforce_statfs=1;
        ip6=inherit;
        ip4=inherit;
....

I reckon not all of them might be required though. Some other parameters are for other functionalities e.g. for system monitoring. There are some other guides on the net and in the forum.

Cath O'Deray · Jun 13, 2022

Sivan! said:
… might have mixed up something somewhere. …

That may be an understatement

Sivan! said:
double https://

cat /usr/local/etc/poudriere.conf > /tmp/poudriere.conf-sivan.txt

Then attach the .txt file to this topic, we can look within the file for possible causes of problems.

Alternatively

Simplify things. Forget about whatever might have gone wrong with whatever preceded this topic. Aim to start afresh.

cp /usr/local/etc/poudriere.conf.sample /usr/local/etc/poudriere.conf

Then go back to step 5 at Getting started …

Cath O'Deray · Jun 13, 2022

Lamia said:
May I add a few lines for those wanting Poudriere in a jail?

To a separate topic, please.

grahamperrin@ said:
Please note, the emphasis here is on getting started – in as few words as possible.

– and:

The ideal is:

for a newcomer to be fearless

for the person to simply get started – nothing more.

The longer we make this topic, the more likely that newcomers will hesitate, or turn away.

Cath O'Deray · Jun 13, 2022

grahamperrin@ said:
<https://old.reddit.com/r/freebsd/comments/vab4yt/-/>

jbodenmann said:
… I assume it's 3.3.7? …

Step 1 specifies ports-mgmt/poudriere-devel, which is currently 3.3.99.20211130.

Sivan! · Jun 13, 2022

grahamperrin@ said:
Alternatively ..... then go back to step 5

Did that.
doas poudriere ports -c

cannot create 'zroot/poudriere/jails': dataset already exists
cannot create 'zroot/poudriere/ports': dataset already exists
[00:00:00] Creating default fs at /usr/local/poudriere/ports/default... done
[00:00:00] Cloning the ports tree... done

Thank you.

Sivan! · Jun 13, 2022

Some errors:

doas pkg install iridium

Updating FreeBSD repository catalogue...
FreeBSD repository is up to date.
Updating poudriere repository catalogue...
pkg: file:///usr/local/poudriere/data/packages/bsd13-default/meta.txz: No such file or directory
repository poudriere has no meta file, using default settings
pkg: file:///usr/local/poudriere/data/packages/bsd13-default/packagesite.pkg: No such file or directory
pkg: file:///usr/local/poudriere/data/packages/bsd13-default/packagesite.txz: No such file or directory
Unable to update repository poudriere
Error updating repositories!

doas pkg update

[same errors]

doas poudriere ports -u

[00:00:00] Updating portstree "default" with git+https... done

doas pkg install iridium

Updating FreeBSD repository catalogue...
FreeBSD repository is up to date.
Updating poudriere repository catalogue...
pkg: file:///usr/local/poudriere/data/packages/bsd13-default/meta.txz: No such file or directory
repository poudriere has no meta file, using default settings
pkg: file:///usr/local/poudriere/data/packages/bsd13-default/packagesite.pkg: No such file or directory
pkg: file:///usr/local/poudriere/data/packages/bsd13-default/packagesite.txz: No such file or directory
Unable to update repository poudriere
Error updating repositories!

Same errors with root privileges.

Solved Getting started with poudriere – with latest packages and OpenZFS

Alternatively​

Alternatively