Solved Cant start MariaDB with Galera Cluster (sh: wsrep_sst_rsync: not found)

When I try to run node: /usr/local/libexec/mysqld --user=root
I have get error: sh: wsrep_sst_rsync: not found
Code:
2019-08-19 13:53:03 2 [Note] WSREP: New cluster view: global state: a6d6c5d8-c282-11e9-b28d-3f1fbf110ba3:0, view# 24: Primary, number of nodes: 2, my index: 1, protocol version 3
2019-08-19 13:53:03 2 [Warning] WSREP: Gap in state sequence. Need state transfer.
2019-08-19 13:53:03 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '10.0.1.112' --datadir '/var/db/mysql/'   --parent '2635'  ''  '''
sh: wsrep_sst_rsync: not found
2019-08-19 13:53:03 0 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_rsync --role 'joiner' --address '10.0.1.112' --datadir '/var/db/mysql/'   --parent '2635'  ''  ''
    Read: '(null)'
2019-08-19 13:53:03 0 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'joiner' --address '10.0.1.112' --datadir '/var/db/mysql/'   --parent '2635'  ''  '': 2 (No such file or directory)
2019-08-19 13:53:03 2 [ERROR] WSREP: Failed to prepare for 'rsync' SST. Unrecoverable.
2019-08-19 13:53:03 2 [ERROR] Aborting

Listing of /usr/local/bin
Code:
root@node2:/usr/local/bin # ls -lh wsrep_sst_*
-rw-r--r--  1 root  wheel   8.2K Aug 10 03:28 wsrep_sst_common
-rwxr-xr-x  1 root  wheel    36K Aug 10 03:28 wsrep_sst_mariabackup
-rwxr-xr-x  1 root  wheel   7.7K Aug 10 03:28 wsrep_sst_mysqldump
-rwxrwxrwx  1 root  wheel    16K Aug 10 03:28 wsrep_sst_rsync
lrwxr-xr-x  1 root  wheel    15B Aug 10 04:19 wsrep_sst_rsync_wan -> wsrep_sst_rsync

My.cnf
root@node2:/usr/local/bin # cat /usr/local/etc/my.cnf
[mysqld]
binlog_format=ROW
default-storage-engine=innodb
innodb_autoinc_lock_mode=2
bind-address=0.0.0.0

# Galera Provider Configuration
wsrep_on=ON
wsrep_provider=/usr/local/lib/libgalera.so

# Galera Cluster Configuration
wsrep_cluster_name="mycluster"
wsrep_cluster_address="gcomm://node1,node2,node3"

# Galera Synchronization Configuration
wsrep_sst_method=rsync

# Galera Node Configuration
wsrep_node_address="10.0.1.112"
wsrep_node_name="node2"
[/CODE]

If I`m right mysqld cant find wsrep_sst_rsync file who storen in /usr/local/bin
FreeBSD 12.0
mariadb103-server-10.3.16
mariadb103-client-10.3.16
galera-25.3.26
 
Have same error.

service mysql-server start
Starting mysql.

service mysql-server status
mysql is not running.


cat /var/db/mysql/node2.err

Code:
2019-08-19 14:14:12 0 [Note] WSREP: Read nil XID from storage engines, skipping position init
2019-08-19 14:14:12 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/local/lib/libgalera.so'
2019-08-19 14:14:12 0 [Note] WSREP: wsrep_load(): Galera 3.26(rrelease_25.3.26) by Codership Oy <info@codership.com> loaded successfully.
2019-08-19 14:14:12 0 [Note] WSREP: CRC-32C: using hardware acceleration.
2019-08-19 14:14:12 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1
2019-08-19 14:14:12 0 [Note] WSREP: Passing config to GCS: base_dir = /var/db/mysql/; base_host = 10.0.1.112; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/db/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/db/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.c
2019-08-19 14:14:12 0 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1
2019-08-19 14:14:12 0 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
2019-08-19 14:14:12 0 [Note] WSREP: wsrep_sst_grab()
2019-08-19 14:14:12 0 [Note] WSREP: Start replication
2019-08-19 14:14:12 0 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
2019-08-19 14:14:12 0 [Note] WSREP: protonet asio version 0
2019-08-19 14:14:12 0 [Note] WSREP: Using CRC-32C for message checksums.
2019-08-19 14:14:12 0 [Note] WSREP: backend: asio
2019-08-19 14:14:12 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2019-08-19 14:14:12 0 [Warning] WSREP: access file(/var/db/mysql//gvwstate.dat) failed(No such file or directory)
2019-08-19 14:14:12 0 [Note] WSREP: restore pc from disk failed
2019-08-19 14:14:12 0 [Note] WSREP: GMCast version 0
2019-08-19 14:14:12 0 [Note] WSREP: (9e5c23d0, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2019-08-19 14:14:12 0 [Note] WSREP: (9e5c23d0, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2019-08-19 14:14:12 0 [Note] WSREP: EVS version 0
2019-08-19 14:14:12 0 [Note] WSREP: gcomm: connecting to group 'mycluster', peer 'node1:,node2:,node3:'
2019-08-19 14:14:12 0 [Note] WSREP: (9e5c23d0, 'tcp://0.0.0.0:4567') connection established to 9e5c23d0 tcp://10.0.1.112:4567
2019-08-19 14:14:12 0 [Warning] WSREP: (9e5c23d0, 'tcp://0.0.0.0:4567') address 'tcp://10.0.1.112:4567' points to own listening address, blacklisting
2019-08-19 14:14:12 0 [Note] WSREP: (9e5c23d0, 'tcp://0.0.0.0:4567') connection established to 85b625d3 tcp://10.0.1.111:4567
2019-08-19 14:14:12 0 [Note] WSREP: (9e5c23d0, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2019-08-19 14:14:12 0 [Note] WSREP: declaring 85b625d3 at tcp://10.0.1.111:4567 stable
2019-08-19 14:14:12 0 [Note] WSREP: Node 85b625d3 state prim
2019-08-19 14:14:14 0 [Note] WSREP: view(view_id(PRIM,85b625d3,32) memb {
    85b625d3,0
    9e5c23d0,0
} joined {
} left {
} partitioned {
})
2019-08-19 14:14:14 0 [Note] WSREP: save pc into disk
2019-08-19 14:14:14 0 [Note] WSREP: discarding pending addr without UUID: tcp://10.0.1.113:4567
2019-08-19 14:14:14 0 [Note] WSREP: gcomm: connected
2019-08-19 14:14:14 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2019-08-19 14:14:14 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2019-08-19 14:14:14 0 [Note] WSREP: Opened channel 'mycluster'
2019-08-19 14:14:14 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2019-08-19 14:14:14 0 [Note] WSREP: Waiting for SST to complete.
2019-08-19 14:14:14 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2019-08-19 14:14:14 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9f75ccd8-c28b-11e9-a997-1b091a8c877d
2019-08-19 14:14:14 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9f75ccd8-c28b-11e9-a997-1b091a8c877d from 0 (node1)
2019-08-19 14:14:14 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9f75ccd8-c28b-11e9-a997-1b091a8c877d from 1 (node2)
2019-08-19 14:14:14 0 [Note] WSREP: Quorum results:
    version    = 4,
    component  = PRIMARY,
    conf_id    = 31,
    members    = 1/2 (joined/total),
    act_id     = 0,
    last_appl. = -1,
    protocols  = 0/9/3 (gcs/repl/appl),
    group UUID = a6d6c5d8-c282-11e9-b28d-3f1fbf110ba3
2019-08-19 14:14:14 0 [Note] WSREP: Flow-control interval: [23, 23]
2019-08-19 14:14:14 0 [Note] WSREP: Trying to continue unpaused monitor
2019-08-19 14:14:14 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 0)
2019-08-19 14:14:14 2 [Note] WSREP: State transfer required:
    Group state: a6d6c5d8-c282-11e9-b28d-3f1fbf110ba3:0
    Local state: 00000000-0000-0000-0000-000000000000:-1
2019-08-19 14:14:14 2 [Note] WSREP: New cluster view: global state: a6d6c5d8-c282-11e9-b28d-3f1fbf110ba3:0, view# 32: Primary, number of nodes: 2, my index: 1, protocol version 3
2019-08-19 14:14:14 2 [Warning] WSREP: Gap in state sequence. Need state transfer.
2019-08-19 14:14:14 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '10.0.1.112' --datadir '/var/db/mysql/'  --defaults-extra-file '/var/db/mysql/my.cnf'  --parent '3212'  ''  '''
sh: wsrep_sst_rsync: not found
2019-08-19 14:14:14 0 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_rsync --role 'joiner' --address '10.0.1.112' --datadir '/var/db/mysql/'  --defaults-extra-file '/var/db/mysql/my.cnf'  --parent '3212'  ''  ''
    Read: '(null)'
2019-08-19 14:14:14 0 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'joiner' --address '10.0.1.112' --datadir '/var/db/mysql/'  --defaults-extra-file '/var/db/mysql/my.cnf'  --parent '3212'  ''  '': 2 (No such file or directory)
2019-08-19 14:14:14 2 [ERROR] WSREP: Failed to prepare for 'rsync' SST. Unrecoverable.
2019-08-19 14:14:14 2 [ERROR] Aborting

Error in my_thread_global_end(): 1 threads didn't exit
 
Have you been able to resolve that?

I just ran into the same with mariadb104-server and galera26 on FreeBSD 12.0-RELEASE.

Maybe a missing environmental variable?
 
2019-08-19 13:53:03 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '10.0.1.112' --datadir '/var/db/mysql/' --parent '2635' '' ''' sh: wsrep_sst_rsync: not found
wsrep_sst_rsync it`s BASH script, so you need to install BASH

run: pkg install bash and you Cluster will be start :beer:;)
 
Back
Top