By type
2024-01-15 16:38:10+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:11.1.2+maria~ubu2204 started.
2024-01-15 16:38:10+00:00 [Note] [Entrypoint]: MariaDB upgrade information missing, assuming required
2024-01-15 16:38:10+00:00 [Note] [Entrypoint]: MariaDB upgrade (mariadb-upgrade) required, but skipped due to $MARIADB_AUTO_UPGRADE setting
2024-01-15 16:38:10 0 [Note] Starting MariaDB 11.1.2-MariaDB-1:11.1.2+maria~ubu2204 source revision 9bc25d98209df6810f7a7d5e7dd3ae677a313ab5 as process 1
2024-01-15 16:38:10 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1
2024-01-15 16:38:10 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'
2024-01-15 16:38:10 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy loaded successfully.
2024-01-15 16:38:10 0 [Note] WSREP: Initializing allowlist service v1
2024-01-15 16:38:10 0 [Note] WSREP: Initializing event service v1
2024-01-15 16:38:10 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.
2024-01-15 16:38:10 0 [Note] WSREP: Found saved state: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3, safe_to_bootstrap: 0
2024-01-15 16:38:10 0 [Note] WSREP: GCache DEBUG: opened preamble:
Version: 2
UUID: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28
Seqno: 3 - 3
Offset: 1280
Synced: 1
2024-01-15 16:38:10 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28, offset: 1280
2024-01-15 16:38:10 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/134217752 bytes) complete.
2024-01-15 16:38:10 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete.
2024-01-15 16:38:10 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 3-3
2024-01-15 16:38:10 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/352 bytes) complete.
2024-01-15 16:38:10 0 [Note] WSREP: Recovering GCache ring buffer: found 0/1 locked buffers
2024-01-15 16:38:10 0 [Note] WSREP: Recovering GCache ring buffer: free space: 134217376/134217728
2024-01-15 16:38:10 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (352/352 bytes) complete.
2024-01-15 16:38:10 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = mariadb-galera-1.mariadb-galera-internal.onap.svc.cluster.local; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_lim
2024-01-15 16:38:11 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:38:11 0 [Note] WSREP: ####### Assign initial position for certification: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3, protocol version: -1
2024-01-15 16:38:11 0 [Note] WSREP: Start replication
2024-01-15 16:38:11 0 [Note] WSREP: Connecting with bootstrap option: 0
2024-01-15 16:38:11 0 [Note] WSREP: Setting GCS initial position to 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3
2024-01-15 16:38:11 0 [Note] WSREP: Using CRC-32C for message checksums.
2024-01-15 16:38:11 0 [Note] WSREP: backend: asio
2024-01-15 16:38:11 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2024-01-15 16:38:11 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)
2024-01-15 16:38:11 0 [Note] WSREP: restore pc from disk failed
2024-01-15 16:38:11 0 [Note] WSREP: GMCast version 0
2024-01-15 16:38:11 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2024-01-15 16:38:11 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2024-01-15 16:38:11 0 [Note] WSREP: EVS version 1
2024-01-15 16:38:11 0 [Note] WSREP: gcomm: connecting to group 'mariadb-operator', peer 'mariadb-galera-0.mariadb-galera-internal.onap.svc.cluster.local:,mariadb-galera-1.mariadb-galera-internal.onap.svc.cluster.local:,mariadb-galera-2.mariadb-galera-internal.onap.svc.cluster.local:'
2024-01-15 16:38:11 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://10.233.71.105:4567
2024-01-15 16:38:11 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') connection established to 3cb02771-8d93 tcp://10.233.65.189:4567
2024-01-15 16:38:11 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2024-01-15 16:38:11 0 [Note] WSREP: EVS version upgrade 0 -> 1
2024-01-15 16:38:11 0 [Note] WSREP: declaring 3cb02771-8d93 at tcp://10.233.65.189:4567 stable
2024-01-15 16:38:11 0 [Note] WSREP: PC protocol upgrade 0 -> 1
2024-01-15 16:38:11 0 [Note] WSREP: Node 3cb02771-8d93 state prim
2024-01-15 16:38:11 0 [Note] WSREP: view(view_id(PRIM,3cb02771-8d93,4) memb {
3cb02771-8d93,0
788c1f72-abb9,0
} joined {
} left {
} partitioned {
})
2024-01-15 16:38:11 0 [Note] WSREP: save pc into disk
2024-01-15 16:38:11 0 [Note] WSREP: discarding pending addr without UUID: tcp://10.233.64.224:4567
2024-01-15 16:38:12 0 [Note] WSREP: gcomm: connected
2024-01-15 16:38:12 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2024-01-15 16:38:12 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2024-01-15 16:38:12 0 [Note] WSREP: Opened channel 'mariadb-operator'
2024-01-15 16:38:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2024-01-15 16:38:12 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2024-01-15 16:38:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 79136b66-b3c4-11ee-8367-ab317878421a
2024-01-15 16:38:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 79136b66-b3c4-11ee-8367-ab317878421a from 0 (mariadb-galera-0)
2024-01-15 16:38:12 0 [Note] WSREP: Initializing config service v1
2024-01-15 16:38:12 0 [Note] WSREP: Deinitializing config service v1
2024-01-15 16:38:12 1 [Note] WSREP: Starting rollbacker thread 1
2024-01-15 16:38:12 2 [Note] WSREP: Starting applier thread 2
2024-01-15 16:38:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 79136b66-b3c4-11ee-8367-ab317878421a from 1 (mariadb-galera-1)
2024-01-15 16:38:12 0 [Note] WSREP: Quorum results:
version = 6,
component = PRIMARY,
conf_id = 3,
members = 1/2 (joined/total),
act_id = 4,
last_appl. = 1,
protocols = 2/10/4 (gcs/repl/appl),
vote policy= 0,
group UUID = 391a6de9-b3c4-11ee-a0c4-a2e560a33e28
2024-01-15 16:38:12 0 [Note] WSREP: Flow-control interval: [23, 23]
2024-01-15 16:38:12 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 5)
2024-01-15 16:38:12 2 [Note] WSREP: ####### processing CC 5, local, ordered
2024-01-15 16:38:12 2 [Note] WSREP: Process first view: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28 my uuid: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d
2024-01-15 16:38:12 2 [Note] WSREP: Server mariadb-galera-1 connected to cluster at position 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:5 with ID 788c1f72-b3c4-11ee-abb9-2b3b86e0912d
2024-01-15 16:38:12 2 [Note] WSREP: Server status change disconnected -> connected
2024-01-15 16:38:12 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:12 2 [Note] WSREP: ####### My UUID: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d
2024-01-15 16:38:12 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes
2024-01-15 16:38:12 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:38:12 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
2024-01-15 16:38:12 2 [Note] WSREP: State transfer required:
Group state: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:5
Local state: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3
2024-01-15 16:38:12 2 [Note] WSREP: Server status change connected -> joiner
2024-01-15 16:38:12 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:12 0 [Note] WSREP: Joiner monitor thread started to monitor
2024-01-15 16:38:12 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address 'mariadb-galera-1.mariadb-galera-internal.onap.svc.cluster.local' --datadir '/var/lib/mysql/' --parent 1 --progress 0'
WSREP_SST: [INFO] mariabackup SST started on joiner (20240115 16:38:12.294)
WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20240115 16:38:12.350)
WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/bin:/sbin:/bin (20240115 16:38:12.478)
WSREP_SST: [INFO] Disabling all progress/rate-limiting (20240115 16:38:12.481)
WSREP_SST: [INFO] Moving '/var/lib/mysql/mariabackup.prepare.log' to '/tmp/sst_log_archive/mariabackup.prepare.log.2024.01.15-16.38.12.498163612' (20240115 16:38:12.505)
WSREP_SST: [INFO] Moving '/var/lib/mysql/mariabackup.move.log' to '/tmp/sst_log_archive/mariabackup.move.log.2024.01.15-16.38.12.498163612' (20240115 16:38:12.516)
WSREP_SST: [INFO] Streaming with mbstream (20240115 16:38:12.526)
WSREP_SST: [INFO] Using socat as streamer (20240115 16:38:12.529)
WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20240115 16:38:12.580)
2024-01-15 16:38:12 2 [Note] WSREP: ####### IST uuid:391a6de9-b3c4-11ee-a0c4-a2e560a33e28 f: 4, l: 5, STRv: 3
2024-01-15 16:38:12 2 [Note] WSREP: IST receiver addr using tcp://mariadb-galera-1.mariadb-galera-internal.onap.svc.cluster.local:4568
2024-01-15 16:38:12 2 [Note] WSREP: Prepared IST receiver for 4-5, listening at: tcp://10.233.71.105:4568
2024-01-15 16:38:12 0 [Note] WSREP: Member 1.0 (mariadb-galera-1) requested state transfer from '*any*'. Selected 0.0 (mariadb-galera-0)(SYNCED) as donor.
2024-01-15 16:38:12 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 5)
2024-01-15 16:38:12 2 [Note] WSREP: Requesting state transfer: success, donor: 0
2024-01-15 16:38:13 0 [Note] WSREP: 0.0 (mariadb-galera-0): State transfer to 1.0 (mariadb-galera-1) complete.
2024-01-15 16:38:13 0 [Note] WSREP: Member 0.0 (mariadb-galera-0) synced with group.
WSREP_SST: [INFO] 'xtrabackup_ist' received from donor: Running IST (20240115 16:38:13.522)
WSREP_SST: [INFO] Galera co-ords from recovery: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3 0 (20240115 16:38:13.528)
WSREP_SST: [INFO] Total time on joiner: 0 seconds (20240115 16:38:13.531)
WSREP_SST: [INFO] mariabackup IST completed on joiner (20240115 16:38:13.535)
WSREP_SST: [INFO] Removing the sst_in_progress file (20240115 16:38:13.539)
WSREP_SST: [INFO] Cleaning up temporary directories (20240115 16:38:13.544)
2024-01-15 16:38:13 3 [Note] WSREP: SST received
2024-01-15 16:38:13 3 [Note] WSREP: Server status change joiner -> initializing
2024-01-15 16:38:13 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:13 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2024-01-15 16:38:13 0 [Note] InnoDB: Number of transaction pools: 1
2024-01-15 16:38:13 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2024-01-15 16:38:13 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts)
2024-01-15 16:38:13 0 [Warning] mariadbd: io_uring_queue_init() failed with ENOMEM: try larger memory locked limit, ulimit -l, or https://mariadb.com/kb/en/systemd/#configuring-limitmemlock under systemd (262144 bytes required)
2024-01-15 16:38:13 0 [Warning] InnoDB: liburing disabled: falling back to innodb_use_native_aio=OFF
2024-01-15 16:38:13 0 [Note] InnoDB: Initializing buffer pool, total size = 2.000GiB, chunk size = 32.000MiB
2024-01-15 16:38:13 0 [Note] InnoDB: Completed initialization of buffer pool
2024-01-15 16:38:13 0 [Note] InnoDB: File system buffers for log disabled (block size=512 bytes)
2024-01-15 16:38:13 0 [Note] InnoDB: End of log at LSN=57845
2024-01-15 16:38:13 0 [Note] InnoDB: Opened 3 undo tablespaces
2024-01-15 16:38:13 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active.
2024-01-15 16:38:13 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ...
2024-01-15 16:38:13 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB.
2024-01-15 16:38:13 0 [Note] InnoDB: log sequence number 57845; transaction id 41
2024-01-15 16:38:13 0 [Note] Plugin 'FEEDBACK' is disabled.
2024-01-15 16:38:13 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2024-01-15 16:38:13 0 [Warning] 'innodb-log-files-in-group' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2024-01-15 16:38:13 0 [Warning] 'innodb-file-format' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2024-01-15 16:38:13 0 [Note] InnoDB: Buffer pool(s) load completed at 240115 16:38:13
2024-01-15 16:38:14 0 [Note] Server socket created on IP: '0.0.0.0'.
2024-01-15 16:38:14 0 [Note] mariadbd: Event Scheduler: Loaded 0 events
2024-01-15 16:38:14 0 [Note] WSREP: wsrep_init_schema_and_SR (nil)
2024-01-15 16:38:14 0 [Note] WSREP: Server initialized
2024-01-15 16:38:14 0 [Note] WSREP: Server status change initializing -> initialized
2024-01-15 16:38:14 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:14 3 [Note] WSREP: Recovered position from storage: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3
2024-01-15 16:38:14 3 [Note] WSREP: Recovered view from SST:
id: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: -1
members(2):
0: 3cb02771-b3c4-11ee-8d93-c7be3d136848, mariadb-galera-0
1: 6c182231-b3c4-11ee-9b3b-9693d07b9e7b, mariadb-galera-1
2024-01-15 16:38:14 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:14 6 [Note] WSREP: Recovered cluster id 391a6de9-b3c4-11ee-a0c4-a2e560a33e28
2024-01-15 16:38:14 3 [Note] WSREP: SST received: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3
2024-01-15 16:38:14 3 [Note] WSREP: SST succeeded for position 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3
2024-01-15 16:38:14 2 [Note] WSREP: Installed new state from SST: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3
2024-01-15 16:38:14 0 [Note] WSREP: Joiner monitor thread ended with total time 2 sec
2024-01-15 16:38:14 0 [Note] mariadbd: ready for connections.
Version: '11.1.2-MariaDB-1:11.1.2+maria~ubu2204' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution
2024-01-15 16:38:14 2 [Note] WSREP: Receiving IST: 2 writesets, seqnos 4-5
2024-01-15 16:38:14 0 [Note] WSREP: ####### IST applying starts with 4
2024-01-15 16:38:14 0 [Note] WSREP: ####### IST current seqno initialized to 4
2024-01-15 16:38:14 0 [Note] WSREP: Receiving IST... 0.0% (0/2 events) complete.
2024-01-15 16:38:14 0 [Note] WSREP: REPL Protocols: 10 (5)
2024-01-15 16:38:14 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:38:14 0 [Note] WSREP: ####### Assign initial position for certification: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:3, protocol version: 5
2024-01-15 16:38:14 0 [Note] WSREP: REPL Protocols: 10 (5)
2024-01-15 16:38:14 0 [Note] WSREP: ####### Adjusting cert position: 3 -> 4
2024-01-15 16:38:14 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:38:14 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 4
2024-01-15 16:38:14 0 [Note] WSREP: Min available from gcache for CC from ist: 3
2024-01-15 16:38:14 0 [Note] WSREP: IST preload starting at 5
2024-01-15 16:38:14 2 [Note] WSREP: ================================================
View:
id: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:4
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: -1
members(1):
0: 3cb02771-b3c4-11ee-8d93-c7be3d136848, mariadb-galera-0
=================================================
2024-01-15 16:38:14 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:14 0 [Note] WSREP: REPL Protocols: 10 (5)
2024-01-15 16:38:14 0 [Note] WSREP: ####### Adjusting cert position: 4 -> 5
2024-01-15 16:38:14 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:38:14 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 5
2024-01-15 16:38:14 0 [Note] WSREP: Min available from gcache for CC from ist: 3
2024-01-15 16:38:14 0 [Note] WSREP: Receiving IST...100.0% (2/2 events) complete.
2024-01-15 16:38:14 2 [Note] WSREP: ================================================
View:
id: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:5
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: 1
members(2):
0: 3cb02771-b3c4-11ee-8d93-c7be3d136848, mariadb-galera-0
1: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d, mariadb-galera-1
=================================================
2024-01-15 16:38:14 2 [Note] WSREP: Server status change initialized -> joined
2024-01-15 16:38:14 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:14 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:38:14 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting off
2024-01-15 16:38:14 2 [Note] WSREP: Draining apply monitors after IST up to 5
2024-01-15 16:38:14 2 [Note] WSREP: IST received: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:5
2024-01-15 16:38:14 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 5
2024-01-15 16:38:14 2 [Note] WSREP: Min available from gcache for CC from sst: 3
2024-01-15 16:38:14 0 [Note] WSREP: 1.0 (mariadb-galera-1): State transfer from 0.0 (mariadb-galera-0) complete.
2024-01-15 16:38:14 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 5)
2024-01-15 16:38:14 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete.
2024-01-15 16:38:14 0 [Note] WSREP: Member 1.0 (mariadb-galera-1) synced with group.
2024-01-15 16:38:14 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete.
2024-01-15 16:38:14 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5)
2024-01-15 16:38:14 2 [Note] WSREP: Server mariadb-galera-1 synced with group
2024-01-15 16:38:14 2 [Note] WSREP: Server status change joined -> synced
2024-01-15 16:38:14 2 [Note] WSREP: Synchronized with group, ready for connections
2024-01-15 16:38:14 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:39:35 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.233.64.224:4567
2024-01-15 16:39:35 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') connection established to aaaad354-bf54 tcp://10.233.64.224:4567
2024-01-15 16:39:36 0 [Note] WSREP: declaring 3cb02771-8d93 at tcp://10.233.65.189:4567 stable
2024-01-15 16:39:36 0 [Note] WSREP: declaring aaaad354-bf54 at tcp://10.233.64.224:4567 stable
2024-01-15 16:39:36 0 [Note] WSREP: Node 3cb02771-8d93 state prim
2024-01-15 16:39:36 0 [Note] WSREP: view(view_id(PRIM,3cb02771-8d93,5) memb {
3cb02771-8d93,0
788c1f72-abb9,0
aaaad354-bf54,0
} joined {
} left {
} partitioned {
})
2024-01-15 16:39:36 0 [Note] WSREP: save pc into disk
2024-01-15 16:39:36 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2024-01-15 16:39:36 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2024-01-15 16:39:36 0 [Warning] WSREP: last inactive check more than PT1.5S ago (PT1.5336S), skipping check
2024-01-15 16:39:36 0 [Note] WSREP: STATE EXCHANGE: sent state msg: ab6ec726-b3c4-11ee-841c-ee62d05f0500
2024-01-15 16:39:36 0 [Note] WSREP: STATE EXCHANGE: got state msg: ab6ec726-b3c4-11ee-841c-ee62d05f0500 from 0 (mariadb-galera-0)
2024-01-15 16:39:36 0 [Note] WSREP: STATE EXCHANGE: got state msg: ab6ec726-b3c4-11ee-841c-ee62d05f0500 from 2 (mariadb-galera-2)
2024-01-15 16:39:36 0 [Note] WSREP: STATE EXCHANGE: got state msg: ab6ec726-b3c4-11ee-841c-ee62d05f0500 from 1 (mariadb-galera-1)
2024-01-15 16:39:36 0 [Note] WSREP: Quorum results:
version = 6,
component = PRIMARY,
conf_id = 4,
members = 2/3 (joined/total),
act_id = 5,
last_appl. = 1,
protocols = 2/10/4 (gcs/repl/appl),
vote policy= 0,
group UUID = 391a6de9-b3c4-11ee-a0c4-a2e560a33e28
2024-01-15 16:39:36 0 [Note] WSREP: Flow-control interval: [28, 28]
2024-01-15 16:39:36 2 [Note] WSREP: ####### processing CC 6, local, ordered
2024-01-15 16:39:36 2 [Note] WSREP: ####### My UUID: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d
2024-01-15 16:39:36 2 [Note] WSREP: Skipping cert index reset
2024-01-15 16:39:36 2 [Note] WSREP: REPL Protocols: 10 (5)
2024-01-15 16:39:36 2 [Note] WSREP: ####### Adjusting cert position: 5 -> 6
2024-01-15 16:39:36 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:39:37 2 [Note] WSREP: ================================================
View:
id: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:6
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: 1
members(3):
0: 3cb02771-b3c4-11ee-8d93-c7be3d136848, mariadb-galera-0
1: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d, mariadb-galera-1
2: aaaad354-b3c4-11ee-bf54-a2e332dd7720, mariadb-galera-2
=================================================
2024-01-15 16:39:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:39:37 2 [Note] WSREP: Lowest cert index boundary for CC from group: 6
2024-01-15 16:39:37 2 [Note] WSREP: Min available from gcache for CC from group: 3
2024-01-15 16:39:37 0 [Note] WSREP: Member 2.0 (mariadb-galera-2) requested state transfer from '*any*'. Selected 0.0 (mariadb-galera-0)(SYNCED) as donor.
2024-01-15 16:39:38 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting off
2024-01-15 16:39:51 0 [Note] WSREP: 0.0 (mariadb-galera-0): State transfer to 2.0 (mariadb-galera-2) complete.
2024-01-15 16:39:51 0 [Note] WSREP: Member 0.0 (mariadb-galera-0) synced with group.
2024-01-15 16:39:55 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.233.64.224:4567
2024-01-15 16:39:55 0 [Note] WSREP: declaring 3cb02771-8d93 at tcp://10.233.65.189:4567 stable
2024-01-15 16:39:55 0 [Note] WSREP: forgetting aaaad354-bf54 (tcp://10.233.64.224:4567)
2024-01-15 16:39:55 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting off
2024-01-15 16:39:55 0 [Note] WSREP: Node 3cb02771-8d93 state prim
2024-01-15 16:39:55 0 [Note] WSREP: view(view_id(PRIM,3cb02771-8d93,6) memb {
3cb02771-8d93,0
788c1f72-abb9,0
} joined {
} left {
} partitioned {
aaaad354-bf54,0
})
2024-01-15 16:39:55 0 [Note] WSREP: save pc into disk
2024-01-15 16:39:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2024-01-15 16:39:55 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2024-01-15 16:39:55 0 [Note] WSREP: forgetting aaaad354-bf54 (tcp://10.233.64.224:4567)
2024-01-15 16:39:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: b6b3e601-b3c4-11ee-9a29-f2134b480afc
2024-01-15 16:39:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: b6b3e601-b3c4-11ee-9a29-f2134b480afc from 0 (mariadb-galera-0)
2024-01-15 16:39:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: b6b3e601-b3c4-11ee-9a29-f2134b480afc from 1 (mariadb-galera-1)
2024-01-15 16:39:55 0 [Note] WSREP: Quorum results:
version = 6,
component = PRIMARY,
conf_id = 5,
members = 2/2 (joined/total),
act_id = 6,
last_appl. = 1,
protocols = 2/10/4 (gcs/repl/appl),
vote policy= 0,
group UUID = 391a6de9-b3c4-11ee-a0c4-a2e560a33e28
2024-01-15 16:39:55 0 [Note] WSREP: Flow-control interval: [23, 23]
2024-01-15 16:39:55 2 [Note] WSREP: ####### processing CC 7, local, ordered
2024-01-15 16:39:55 2 [Note] WSREP: ####### My UUID: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d
2024-01-15 16:39:55 2 [Note] WSREP: Skipping cert index reset
2024-01-15 16:39:55 2 [Note] WSREP: REPL Protocols: 10 (5)
2024-01-15 16:39:55 2 [Note] WSREP: ####### Adjusting cert position: 6 -> 7
2024-01-15 16:39:55 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:39:55 2 [Note] WSREP: ================================================
View:
id: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:7
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: 1
members(2):
0: 3cb02771-b3c4-11ee-8d93-c7be3d136848, mariadb-galera-0
1: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d, mariadb-galera-1
=================================================
2024-01-15 16:39:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:39:55 2 [Note] WSREP: Lowest cert index boundary for CC from group: 7
2024-01-15 16:39:55 2 [Note] WSREP: Min available from gcache for CC from group: 3
2024-01-15 16:39:56 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') connection established to b7077a77-b791 tcp://10.233.64.224:4567
2024-01-15 16:39:56 0 [Note] WSREP: remote endpoint tcp://10.233.64.224:4567 changed identity aaaad354-b3c4-11ee-bf54-a2e332dd7720 -> b7077a77-b3c4-11ee-b791-42df1cefd577
2024-01-15 16:39:56 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2024-01-15 16:39:56 0 [Note] WSREP: declaring 3cb02771-8d93 at tcp://10.233.65.189:4567 stable
2024-01-15 16:39:56 0 [Note] WSREP: declaring b7077a77-b791 at tcp://10.233.64.224:4567 stable
2024-01-15 16:39:56 0 [Note] WSREP: Node 3cb02771-8d93 state prim
2024-01-15 16:39:56 0 [Note] WSREP: view(view_id(PRIM,3cb02771-8d93,7) memb {
3cb02771-8d93,0
788c1f72-abb9,0
b7077a77-b791,0
} joined {
} left {
} partitioned {
})
2024-01-15 16:39:56 0 [Note] WSREP: save pc into disk
2024-01-15 16:39:56 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2024-01-15 16:39:56 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2024-01-15 16:39:56 0 [Note] WSREP: STATE EXCHANGE: sent state msg: b7b5e5f6-b3c4-11ee-82cc-e73dad931020
2024-01-15 16:39:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: b7b5e5f6-b3c4-11ee-82cc-e73dad931020 from 0 (mariadb-galera-0)
2024-01-15 16:39:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: b7b5e5f6-b3c4-11ee-82cc-e73dad931020 from 1 (mariadb-galera-1)
2024-01-15 16:39:57 0 [Note] WSREP: STATE EXCHANGE: got state msg: b7b5e5f6-b3c4-11ee-82cc-e73dad931020 from 2 (mariadb-galera-2)
2024-01-15 16:39:57 0 [Note] WSREP: Quorum results:
version = 6,
component = PRIMARY,
conf_id = 6,
members = 2/3 (joined/total),
act_id = 7,
last_appl. = 1,
protocols = 2/10/4 (gcs/repl/appl),
vote policy= 0,
group UUID = 391a6de9-b3c4-11ee-a0c4-a2e560a33e28
2024-01-15 16:39:57 0 [Note] WSREP: Flow-control interval: [28, 28]
2024-01-15 16:39:57 2 [Note] WSREP: ####### processing CC 8, local, ordered
2024-01-15 16:39:57 2 [Note] WSREP: ####### My UUID: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d
2024-01-15 16:39:57 2 [Note] WSREP: Skipping cert index reset
2024-01-15 16:39:57 2 [Note] WSREP: REPL Protocols: 10 (5)
2024-01-15 16:39:57 2 [Note] WSREP: ####### Adjusting cert position: 7 -> 8
2024-01-15 16:39:57 0 [Note] WSREP: Service thread queue flushed.
2024-01-15 16:39:57 2 [Note] WSREP: ================================================
View:
id: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:8
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: 1
members(3):
0: 3cb02771-b3c4-11ee-8d93-c7be3d136848, mariadb-galera-0
1: 788c1f72-b3c4-11ee-abb9-2b3b86e0912d, mariadb-galera-1
2: b7077a77-b3c4-11ee-b791-42df1cefd577, mariadb-galera-2
=================================================
2024-01-15 16:39:57 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:39:57 2 [Note] WSREP: Lowest cert index boundary for CC from group: 8
2024-01-15 16:39:57 2 [Note] WSREP: Min available from gcache for CC from group: 3
2024-01-15 16:39:58 0 [Note] WSREP: Member 2.0 (mariadb-galera-2) requested state transfer from '*any*'. Selected 1.0 (mariadb-galera-1)(SYNCED) as donor.
2024-01-15 16:39:58 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 8)
2024-01-15 16:39:58 2 [Note] WSREP: Detected STR version: 1, req_len: 229, req: STRv1
2024-01-15 16:39:58 2 [Note] WSREP: IST request: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:6-8|tcp://mariadb-galera-2.mariadb-galera-internal.onap.svc.cluster.local:4568
2024-01-15 16:39:58 2 [Note] WSREP: Server status change synced -> donor
2024-01-15 16:39:58 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:39:58 0 [Note] WSREP: Donor monitor thread started to monitor
2024-01-15 16:39:58 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address 'mariadb-galera-2.mariadb-galera-internal.onap.svc.cluster.local:4444/xtrabackup_sst//1' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '391a6de9-b3c4-11ee-a0c4-a2e560a33e28:6' --gtid-domain-id 0 --bypass'
2024-01-15 16:39:58 2 [Note] WSREP: sst_donor_thread signaled with 0
2024-01-15 16:39:58 0 [Note] WSREP: async IST sender starting to serve tcp://mariadb-galera-2.mariadb-galera-internal.onap.svc.cluster.local:4568 sending 7-8, preload starts from 8
2024-01-15 16:39:58 0 [Note] WSREP: IST sender 7 -> 8
WSREP_SST: [INFO] mariabackup IST started on donor (20240115 16:39:58.401)
WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20240115 16:39:58.459)
WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/bin:/sbin:/bin (20240115 16:39:58.609)
WSREP_SST: [INFO] Disabling all progress/rate-limiting (20240115 16:39:58.613)
WSREP_SST: [INFO] Streaming with mbstream (20240115 16:39:58.638)
WSREP_SST: [INFO] Using socat as streamer (20240115 16:39:58.641)
WSREP_SST: [INFO] Bypassing the SST for IST (20240115 16:39:58.651)
WSREP_SST: [INFO] Evaluating '/usr//bin/mbstream' -c 'mariadb_backup_galera_info' 'xtrabackup_ist' | socat -u stdio TCP:mariadb-galera-2.mariadb-galera-internal.onap.svc.cluster.local:4444; RC=( ${PIPESTATUS[@]} ) (20240115 16:39:58.657)
2024-01-15 16:39:58 0 [Note] WSREP: SST sent: 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:6
2024-01-15 16:39:58 0 [Note] WSREP: Server status change donor -> joined
2024-01-15 16:39:58 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
WSREP_SST: [INFO] Total time on donor: 0 seconds (20240115 16:39:58.672)
WSREP_SST: [INFO] mariabackup IST completed on donor (20240115 16:39:58.678)
WSREP_SST: [INFO] Cleaning up temporary directories (20240115 16:39:58.684)
2024-01-15 16:39:58 0 [Note] WSREP: 1.0 (mariadb-galera-1): State transfer to 2.0 (mariadb-galera-2) complete.
2024-01-15 16:39:58 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 8)
2024-01-15 16:39:58 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete.
2024-01-15 16:39:58 0 [Note] WSREP: Donor monitor thread ended with total time 0 sec
2024-01-15 16:39:58 0 [Note] WSREP: Member 1.0 (mariadb-galera-1) synced with group.
2024-01-15 16:39:58 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete.
2024-01-15 16:39:58 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 8)
2024-01-15 16:39:58 2 [Note] WSREP: Server mariadb-galera-1 synced with group
2024-01-15 16:39:58 2 [Note] WSREP: Server status change joined -> synced
2024-01-15 16:39:58 2 [Note] WSREP: Synchronized with group, ready for connections
2024-01-15 16:39:58 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2024-01-15 16:39:59 0 [Note] WSREP: (788c1f72-abb9, 'tcp://0.0.0.0:4567') turning message relay requesting off
2024-01-15 16:40:00 0 [Note] WSREP: async IST sender served
2024-01-15 16:40:00 0 [Note] WSREP: 2.0 (mariadb-galera-2): State transfer from 1.0 (mariadb-galera-1) complete.
2024-01-15 16:40:00 0 [Note] WSREP: Member 2.0 (mariadb-galera-2) synced with group.
2024-01-15 17:00:21 0 [Warning] WSREP: Failed to report last committed 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:1158, -110 (Connection timed out)
2024-01-15 17:04:05 0 [Warning] WSREP: Failed to report last committed 391a6de9-b3c4-11ee-a0c4-a2e560a33e28:1796, -110 (Connection timed out)