Solved Cannot upgrade pkg from custom repo

dvl@ · Nov 19, 2015

FreeBSD 10.2-RELEASE-p7 in a jail, using pkg-1.6.1_2

I have a custom repo. I've been using it for some time. Today I wanted to upgrade databases/mysql56-server, but I cannot.

Code:

$ sudo pkg upgrade -r local mysql56-server
Updating local repository catalogue...
local repository is up-to-date.
All repositories are up-to-date.
pkg: No packages available to upgrade matching 'mysql56-server' have been found in the repositories

OK, let's look at All:

Code:

$ pkg -vv | grep url
    url             : "pkg+http://fedex.unixathome.org/packages/102amd64-default-master-list/",
$ 
fetch http://fedex.unixathome.org/packages/102amd64-default-master-list/All
fetch: http://fedex.unixathome.org/packages/102amd64-default-master-list/All: size of remote file is not known
All                                                     88 kB  722 kBps 00m00s

$ ls -l All
-rw-r--r--  1 dan  dan  90209 Nov 19 20:16 All
$ date
Thu Nov 19 20:17:14 UTC 2015

$ grep mysql All
<a href="mysql55-client-5.5.46.txz">mysql55-client-5.5.46.txz</a>                          19-Nov-2015 16:26             1666804
<a href="mysql55-server-5.5.46.txz">mysql55-server-5.5.46.txz</a>                          19-Nov-2015 16:32             6672556
<a href="mysql56-client-5.6.27.txz">mysql56-client-5.6.27.txz</a>                          18-Nov-2015 17:44             2077388
<a href="mysql56-server-5.6.27.txz">mysql56-server-5.6.27.txz</a>                          19-Nov-2015 20:09             8470408
<a href="php55-mysql-5.5.30.txz">php55-mysql-5.5.30.txz</a>                             06-Oct-2015 04:46               17552

I see mysql56-server in there. Definitely.

Let's force a download:

Code:

$ sudo pkg install -r local mysql56-server
Updating local repository catalogue...
local repository is up-to-date.
All repositories are up-to-date.
pkg: No packages available to install matching 'mysql56-server' have been found in the repositories

*sigh*

Any ideas please?

junovitch@ · Nov 20, 2015

Hmm. Issues with the pkg-repo(8) catalogue file creation perhaps? Do you have any errors when you trigger a rebuild of the repository? Alternately, are there any errors manually rebuilding a new catalogue ( pkg repo All executed from the repository directory)?

dvl@ · Nov 20, 2015

I saw no errors when I last built databases/mysql56-server.

This seems to work:

Code:

$ pkg repo -o . /usr/local/poudriere/data/packages/102amd64-default-master-list/All
Creating repository in .: 100%
Packing files for repository: 100%
$ ls -l
total 282
-rw-r--r--  1 dan  dan   62496 Nov 20 03:17 digests.txz
-rw-r--r--  1 dan  dan     264 Nov 20 03:17 meta.txz
-rw-r--r--  1 dan  dan  187812 Nov 20 03:17 packagesite.txz

jrm@ · Nov 20, 2015

I added your repo and it worked for me.

Code:

% sudo pkg install mysql56-client
Updating awarnach repository catalogue...
awarnach repository is up-to-date.
Updating dan repository catalogue...
dan repository is up-to-date.
All repositories are up-to-date.
The following 3 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
        mysql56-client: 5.6.27 [dan]
        jpeg: 8_6 [awarnach]
        mDNSResponder: 576.30.4 [dan]

The process will require 48 MiB more space.
3 MiB to be downloaded.

Proceed with this action? [y/N]:

% pkg -vv | tail -n 5
  dan: {
    url             : "http://fedex.unixathome.org/packages/102amd64-default-master-list/",
    enabled         : yes,
    priority        : 0
  }

junovitch@ · Nov 20, 2015

A client side pkg update -f may be warranted.

dvl@ · Nov 20, 2015

junovitch@ said:
A client side pkg update -f may be warranted.

Code:

[root@zuul-mysql:~] # pkg update -f
Updating local repository catalogue...
[zuul-mysql.vpn.unixathome.org] Fetching meta.txz: 100%    820 B   0.8kB/s    00:01    
[zuul-mysql.vpn.unixathome.org] Fetching packagesite.txz: 100%  184 KiB 188.7kB/s    00:01    
Processing entries: 100%
local repository update completed. 709 packages processed.

[root@zuul-mysql:~] # pkg install mysql56-client
Updating local repository catalogue...
local repository is up-to-date.
All repositories are up-to-date.
Checking integrity... done (0 conflicting)
The most recent version of packages are already installed

[root@zuul-mysql:~] # pkg info -x mysql56-client
mysql56-client-5.6.27
[root@zuul-mysql:~] #

dvl@ · Nov 20, 2015

jrm said:

I added your repo and it worked for me.

Code:

% sudo pkg install mysql56-client
Updating awarnach repository catalogue...
awarnach repository is up-to-date.
Updating dan repository catalogue...
dan repository is up-to-date.
All repositories are up-to-date.
The following 3 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
        mysql56-client: 5.6.27 [dan]
        jpeg: 8_6 [awarnach]
        mDNSResponder: 576.30.4 [dan]

The process will require 48 MiB more space.
3 MiB to be downloaded.

Proceed with this action? [y/N]:

% pkg -vv | tail -n 5
  dan: {
    url             : "http://fedex.unixathome.org/packages/102amd64-default-master-list/",
    enabled         : yes,
    priority        : 0
  }

This points to the issue being on the host, not in the repo. Agreed?

BTW: I am shocked, absolutely shocked, that anyone would trust my binaries.

SirDice · Nov 20, 2015

Does it work if you specify the category? As in pkg install databases/mysql56-client.

dvl@ · Nov 20, 2015

SirDice said:
Does it work if you specify the category? As in pkg install databases/mysql56-client.

Code:

# sudo pkg install databases/mysql56-client
Updating local repository catalogue...
local repository is up-to-date.
All repositories are up-to-date.
Checking integrity... done (0 conflicting)
The most recent version of packages are already installed

SirDice · Nov 20, 2015

Maybe I'm starting to see things but the message says that the most recent version is already installed.

dvl@ · Nov 20, 2015

SirDice said:
Maybe I'm starting to see things but the message says that the most recent version is already installed.

The first command confirms what is available from the repo. The second indicates what is installed.

Code:

[root@zuul-mysql:~] # pkg search -x mysql56-server
mysql56-server-5.6.27          Multithreaded SQL database (server)

[root@zuul-mysql:~] # pkg info -x mysql56-server
mysql56-server-5.6.26

SirDice · Nov 20, 2015

In your first post you specified a repository. Do you have multiple repositories? I can imagine the default one, which is searched by the pkg search -x mysql56-server command might have the newer version but your 'local' repository doesn't have it?

dvl@ · Nov 20, 2015

SirDice said:
In your first post you specified a repository. Do you have multiple repositories? I can imagine the default one, which is searched by the pkg search -x mysql56-server command might have the newer version but your 'local' repository doesn't have it?

Does this answer? I have just one repo; mine.

Code:

# pkg -vv 
Version                 : 1.6.1
PKG_DBDIR = "/var/db/pkg";
PKG_CACHEDIR = "/var/cache/pkg";
PORTSDIR = "/usr/ports";
INDEXDIR = "";
INDEXFILE = "INDEX-10";
HANDLE_RC_SCRIPTS = false;
DEFAULT_ALWAYS_YES = false;
ASSUME_ALWAYS_YES = false;
REPOS_DIR [
    "/usr/local/etc/pkg/repos/",
]
PLIST_KEYWORDS_DIR = "";
SYSLOG = true;
ABI = "FreeBSD:10:amd64";
ALTABI = "freebsd:10:x86:64";
DEVELOPER_MODE = false;
VULNXML_SITE = "http://vuxml.freebsd.org/freebsd/vuln.xml.bz2";
FETCH_RETRY = 3;
PKG_PLUGINS_DIR = "/usr/local/lib/pkg/";
PKG_ENABLE_PLUGINS = true;
PLUGINS [
]
DEBUG_SCRIPTS = false;
PLUGINS_CONF_DIR = "/usr/local/etc/pkg/";
PERMISSIVE = false;
REPO_AUTOUPDATE = true;
NAMESERVER = "";
HTTP_USER_AGENT = "pkg/1.6.1";
EVENT_PIPE = "";
FETCH_TIMEOUT = 30;
UNSET_TIMESTAMP = false;
SSH_RESTRICT_DIR = "";
PKG_ENV {
}
PKG_SSH_ARGS = "";
DEBUG_LEVEL = 0;
ALIAS {
}
CUDF_SOLVER = "";
SAT_SOLVER = "";
RUN_SCRIPTS = true;
CASE_SENSITIVE_MATCH = false;
LOCK_WAIT = 1;
LOCK_RETRIES = 5;
SQLITE_PROFILE = false;
WORKERS_COUNT = 0;
READ_LOCK = false;
PLIST_ACCEPT_DIRECTORIES = false;
IP_VERSION = 0;
AUTOMERGE = true;
VERSION_SOURCE = "";
CONSERVATIVE_UPGRADE = true;
PKG_CREATE_VERBOSE = false;
AUTOCLEAN = false;
DOT_FILE = "";


Repositories:
  local: { 
    url             : "pkg+http://fedex.unixathome.org/packages/102amd64-default-master-list/",
    enabled         : yes,
    priority        : 0,
    mirror_type     : "SRV",
    signature_type  : "PUBKEY",
    pubkey          : "/etc/ssl/slocum.unixathome.org.cert"
  }

SirDice · Nov 20, 2015

That definitely answered it

Few variations to try:
pkg upgrade mysql56-server
pkg upgrade databases/mysql56-server
pkg upgrade mysql-server
(And the same commands using pkg-install(8) instead of pkg-upgrade(8))

dvl@ · Nov 20, 2015

Code:

[root@zuul-mysql:~] # pkg upgrade mysql56-server
Updating local repository catalogue...
local repository is up-to-date.
All repositories are up-to-date.
pkg: No packages available to upgrade matching 'mysql56-server' have been found in the repositories


[root@zuul-mysql:~] # pkg upgrade databases/mysql56-server
Updating local repository catalogue...
local repository is up-to-date.
All repositories are up-to-date.
databases/mysql56-server has no direct installation candidates, change it to mysql56-server? [Y/n]: y                      
Assertion failed: (0), function pkg_jobs_try_remote_candidate, file pkg_jobs.c, line 816.
Child process pid=23378 terminated abnormally: Abort trap


[root@zuul-mysql:~] # pkg upgrade mysql-server
Updating local repository catalogue...
local repository is up-to-date.
All repositories are up-to-date.
pkg: mysql-server is not installed, therefore upgrade is impossible
pkg: No packages available to upgrade matching 'mysql-server' have been found in the repositories
[root@zuul-mysql:~] #

jrm@ · Nov 20, 2015

dvl@ said:
BTW: I am shocked, absolutely shocked, that anyone would trust my binaries.

Note that I didn't paste anything after the [y/N] prompt. ;-)

dvl@ · Dec 8, 2015

solved with pkg unlock.

I declare this a bug.

junovitch@ · Dec 9, 2015

dvl@ said:
solved with pkg unlock.

I declare this a bug.

Thanks Dan. Is there a bug report in for this yet?

dvl@ · Dec 11, 2015

junovitch@ said:
Thanks Dan. Is there a bug report in for this yet?

Just opened: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=205254

Later, reopened at https://github.com/freebsd/pkg/issues/1362

Solved Cannot upgrade pkg from custom repo

dvl@

junovitch@

dvl@

jrm@

junovitch@

dvl@

dvl@

SirDice

Administrator

dvl@

SirDice

Administrator

dvl@

SirDice

Administrator

dvl@

SirDice

Administrator

dvl@

jrm@

dvl@

junovitch@

dvl@