00000100:00100000:3.0F:1787096573.502472:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0F:1787096573.502539:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352888832 00000100:00100000:1.0:1787096573.502559:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352888832 00000100:00080000:3.0:1787096573.502648:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096573.502665:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 347 00000100:00100000:1.0:1787096573.502681:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:39009:x1873906352888832:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1787096573.502722:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096573.502829:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf600/0x1b9fb40e15b44d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc7037 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.502916:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44d09 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.502936:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44d09 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.502952:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44d09 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096573.503104:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787096573.503110:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787096573.503134:0:6480:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44d09 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.503162:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf600/0x1b9fb40e15b44d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7037 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.503185:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44d09 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7037 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.503194:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9c9d6b3e8900) 00010000:00010000:1.0:1787096573.503197:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096573.503201:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cf200, rc 0) 00000100:00100000:1.0:1787096573.503277:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352888832:12345-192.168.203.27@tcp:101:rm.0 Request processed in 602us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096573.503286:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 347 00000100:00100000:3.0:1787096573.506412:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096573.506801:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352888960 00000100:00100000:1.0:1787096573.506814:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352888960 00000100:00100000:1.0:1787096573.506930:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 348 00000100:00100000:1.0:1787096573.506941:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:39009:x1873906352888960:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1787096573.506968:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096573.507002:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc703e expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.507073:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44d17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.507089:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.507102:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096573.507148:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1787096573.507153:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096573.507191:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc703e expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.507205:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44d17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc703e expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.507214:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9c9d6b3f4400) 00010000:00010000:1.0:1787096573.507222:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096573.507226:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce600, rc 0) 00000100:00100000:1.0:1787096573.507286:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352888960:12345-192.168.203.27@tcp:101:rm.0 Request processed in 348us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096573.507293:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 348 00000100:00080000:3.0:1787096573.507815:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0F:1787096573.511301:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096573.511369:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352889088 00000100:00100000:1.0:1787096573.511379:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352889088 00000100:00100000:1.0:1787096573.511510:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:1.0:1787096573.511520:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889088:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:1.0:1787096573.514772:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889088:12345-192.168.203.27@tcp:37:rm.0 Request processed in 3239us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096573.514787:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:3.0:1787096573.517577:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096573.517625:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352889216 00000100:00100000:3.0:1787096573.517638:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352889216 00000100:00100000:3.0:1787096573.517689:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:3.0:1787096573.517699:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889216:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:3.0:1787096573.522183:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889216:12345-192.168.203.27@tcp:37:rm.0 Request processed in 4470us (4599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096573.522198:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:1.0:1787096573.525023:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096573.525183:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352889344 00000100:00100000:3.0:1787096573.525196:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352889344 00000100:00100000:3.0:1787096573.525267:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 349 00000100:00100000:3.0:1787096573.525280:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889344:12345-192.168.203.27@tcp:41:rm.0 00000004:00000024:3.0:1787096573.525349:0:18819:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787096573.525509:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889344:12345-192.168.203.27@tcp:41:rm.0 Request processed in 231us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096573.525518:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 349 00000100:00100000:0.0F:1787096573.527215:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096573.527310:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352889472 00000100:00100000:1.0:1787096573.527321:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352889472 00000100:00100000:1.0:1787096573.527443:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 350 00000100:00100000:1.0:1787096573.527455:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889472:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1787096573.527485:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096573.527512:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc7045 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527600:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527614:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527625:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527648:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527655:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527661:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527741:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44d33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527766:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527774:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096573.527813:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 3145729 00000004:00200000:1.0:1787096573.527817:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096573.527831:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527839:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527846:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527850:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527862:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527867:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527871:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096573.527874:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527881:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527894:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9c9d6b3f4400) 00010000:00010000:1.0:1787096573.527896:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096573.527900:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527904:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44d25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527917:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527923:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527931:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527937:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cec00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096573.527946:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527952:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527962:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0xc0870d27 (ffff9c9d6b3f4800) 00010000:00010000:1.0:1787096573.527964:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096573.527967:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.527973:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b44d2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.528004:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7045 expref: 16 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.528016:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44d33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7045 expref: 15 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.528023:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9c9c42964900) 00010000:00010000:1.0:1787096573.528025:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096573.528028:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cea00, rc 0) 00000100:00100000:1.0:1787096573.528094:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:39009:x1873906352889472:12345-192.168.203.27@tcp:101:rm.0 Request processed in 642us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096573.528102:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 350 00000100:00100000:0.0:1787096573.532078:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096573.532181:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352889728 00000100:00100000:1.0:1787096573.532228:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352889728 00000100:00100000:1.0:1787096573.532326:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 351 00000100:00100000:1.0:1787096573.532338:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:39009:x1873906352889728:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:1.0:1787096573.532426:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787096573.532457:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44d33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7045 expref: 15 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532484:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44c5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7006 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532497:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9c9c42964900) 00010000:00010000:1.0:1787096573.532517:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44d17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc703e expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532525:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9c9d6b3f4400) 00010000:00010000:1.0:1787096573.532531:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096573.532556:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532568:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532579:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532593:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532601:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532608:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532694:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532702:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.532721:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787096573.533038:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8760 00000004:00080000:1.0:1787096573.533050:0:6479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 249197656694ns, next at 250197653803ns, rc = 0 00000040:00080000:1.0:1787096573.533085:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8824 00000004:00080000:1.0:1787096573.533091:0:6479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 249197698551ns, next at 250197696640ns, rc = 0 00000040:00080000:1.0:1787096573.533109:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8824 00000040:00080000:1.0:1787096573.533123:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8888 00010000:00010000:1.0:1787096573.533191:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533200:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533209:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533217:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533223:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533228:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533270:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096573.533291:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533298:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533305:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533312:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096573.533316:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533326:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533337:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9c9d6b3f4a00) 00010000:00010000:1.0:1787096573.533341:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096573.533345:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533351:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44d48 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533373:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533380:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533387:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533436:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533443:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9ce000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096573.533447:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533453:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533464:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9c9d6b3f4c00) 00010000:00010000:1.0:1787096573.533467:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096573.533470:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 3/0,0 mode: --/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533477:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096573.533507:0:6479:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000088e3b28f reply state 00000000a7e23308 transno 4294967431 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533520:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.533527:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0xc0870d27 (ffff9c9d6b3f4000) 00010000:00010000:1.0:1787096573.533529:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096573.533532:0:6479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787096573.533619:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352889728:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1281us (1551us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787096573.533627:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 351 00010000:00010000:3.0:1787096573.533724:0:7403:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096573.533731:0:7403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.533738:0:7403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cfc00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:3.0:1787096573.533743:0:7403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.533751:0:7403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.533772:0:7403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9c9d6b3f4a00) 00010000:00010000:3.0:1787096573.533774:0:7403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096573.533778:0:7403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.533784:0:7403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b44d4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.533809:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096573.533811:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096573.533819:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096573.537429:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096573.537481:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352890112 00000100:00100000:2.0:1787096573.537496:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352890112 00000100:00100000:1.0:1787096573.537504:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096573.537595:0:6467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352889856 00000100:00100000:0.0:1787096573.537605:0:6467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352889856 00000100:00100000:0.0:1787096573.537715:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:0.0:1787096573.537731:0:6467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:2401:x1873906352889856:12345-192.168.203.27@tcp:103:rm.0 00000100:00100000:2.0:1787096573.537754:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00010000:00010000:0.0:1787096573.537755:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787096573.537774:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6b364c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:39009:x1873906352890112:12345-192.168.203.27@tcp:35:rm.0 00010000:00010000:0.0:1787096573.537792:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b448f6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f0a expref: 14 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.537812:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9c9d6b3f4900) 00010000:00010000:0.0:1787096573.537825:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096573.537940:0:6467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:2401:x1873906352889856:12345-192.168.203.27@tcp:103:rm.0 Request processed in 213us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096573.537955:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000040:00080000:2.0:1787096573.538045:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].10, 344 off47616 00000040:00080000:2.0:1787096573.538131:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].10, 424 off49016 00000004:00080000:2.0:1787096573.538140:0:6483:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42bcb840 with version 20 00000004:00080000:0.0:1787096573.538694:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 20 rpc_version 20 00000020:00100000:0.0:1787096573.538752:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096573.538763:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d75981f80 x1873906360287232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096573.538790:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75981f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360287232:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096573.538854:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096573.538923:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e78a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096573.538961:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360287232 00000100:00100000:1.0:1787096573.538968:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360287232 00000100:00100000:1.0:1787096573.539027:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787096573.539036:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7407:x1873906360287232:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096573.539295:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360287232:12345-0@lo:1000:osp_up0-1.0 Request processed in 260us (441us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787096573.539304:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787096573.539378:0:7407:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967406 gen 2 00000004:00080000:0.0:1787096573.539383:0:7407:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967406 committed transno 4294967406 00000100:00100000:0.0:1787096573.539562:0:7407:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9d75981f80 x1873906360287232/t4294967432(4294967432) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 1787096589 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096573.539591:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75981f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360287232:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096573.539718:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6b364c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:39009:x1873906352890112:12345-192.168.203.27@tcp:35:rm.0 Request processed in 1939us (2310us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1787096573.539729:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00000001:00080000:1.0:1787096573.541659:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967359 is committed 00000001:00080000:1.0:1787096573.541689:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967355 is committed 00000020:00080000:1.0:1787096573.541715:0:7392:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9c42ce3f00 refcount 2 committed 0 result 0 batchid 9 00000020:00080000:1.0:1787096573.541720:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d79617e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42ce3d80 00000020:00080000:1.0:1787096573.541725:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].9 00000020:00080000:1.0:1787096573.541728:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d79617000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d6e931400 00000020:00080000:1.0:1787096573.541730:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].9 00000020:00080000:1.0:1787096573.541743:0:7392:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 8 batchid updated 00010000:00010000:0.0:1787096573.541790:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b448b7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541803:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b448b7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541821:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b448b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096573.541828:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00010000:00010000:0.0:1787096573.541834:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceae00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096573.541840:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b448b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541850:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b448b7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541870:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9c9d6b3e8900) 00010000:00010000:0.0:1787096573.541874:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096573.541893:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b448b7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541904:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b448b7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541918:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b448be lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541924:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b448be lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541929:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b448be lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541933:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccebe00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096573.541936:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b448be lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541953:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b448be lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.541962:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffff9c9d6b3e8700) 00010000:00010000:0.0:1787096573.541965:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096573.542183:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b448be lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.542189:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b448be lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096573.542209:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 9 committed batchid 8 00000004:00080000:0.0:1787096573.542332:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42e78a80 with version 21 00000020:00080000:0.0:1787096573.542348:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 8 cancel update log [0x200000401:0x3:0x0].8: rc = 0 00000004:00080000:1.0:1787096573.542374:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 21 rpc_version 21 00000020:00100000:1.0:1787096573.542419:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096573.542428:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d512d3800 x1873906360287488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1787096573.542428:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 8 cancel update log [0x240000400:0x3:0x0].8: rc = 0 00000020:00080000:0.0:1787096573.542443:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787096573.542455:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d512d3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360287488:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096573.542459:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352890368 00000100:00100000:0.0:1787096573.542469:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352890368 00000100:00100000:1.0:1787096573.542505:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096573.542531:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 352 00000100:00100000:0.0:1787096573.542545:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:39009:x1873906352890368:12345-192.168.203.27@tcp:36:rm.0 00000100:00100000:1.0:1787096573.542554:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e45d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787096573.542609:0:9995:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787096573.542632:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b449c8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f50 expref: 9 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.542650:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44d09 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7037 expref: 8 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.542663:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b44904 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f11 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.542680:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9c9d6b3e8900) 00010000:00010000:0.0:1787096573.542695:0:9995:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096573.542750:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.542760:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.542763:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360287488 00000100:00100000:2.0:1787096573.542769:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360287488 00010000:00010000:0.0:1787096573.542774:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096573.542790:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360287616:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787096573.542805:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787096573.542815:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360287488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096573.542823:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096573.542847:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e78b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096573.542850:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360287616 00000100:00100000:1.0:1787096573.542855:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360287616 00000100:00100000:1.0:1787096573.542889:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787096573.542896:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9995:x1873906360287616:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787096573.542904:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096573.542917:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b44d56 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.542939:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b448da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f03 expref: 12 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.542948:0:6485:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.542958:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7407:x1873906360287488:12345-0@lo:1000:osp_up0-1.0 Request processed in 144us (451us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1787096573.542967:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00010000:1.0:1787096573.542971:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b448da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f03 expref: 12 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.542989:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b448da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f03 expref: 12 pid: 9995 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096573.543012:0:6485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d512d1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6485:1873906360287744:192.168.203.27@tcp:104: 00000100:00100000:1.0:1787096573.543084:0:6485:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096573.543108:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d512d3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360287488:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096573.545988:0:6485:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d512d1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6485:1873906360287744:192.168.203.27@tcp:104: 00010000:00010000:1.0:1787096573.546029:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.546043:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096573.546054:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096573.546059:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.546070:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce200, rc 0) 00000100:00100000:1.0:1787096573.546145:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:9995:x1873906360287616:12345-0@lo:101:mdt00_004.0 Request processed in 3248us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096573.546156:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787096573.546583:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360287616:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096573.546602:0:9995:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.546615:0:9995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096573.547132:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096573.547678:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352890496 00000100:00100000:3.0:1787096573.547686:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352890496 00010000:00010000:3.0:1787096573.547735:0:8378:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b448da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f03 expref: 13 pid: 9995 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096573.547804:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00100000:3.0:1787096573.547814:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:2402:x1873906352890496:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096573.547830:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096573.547837:0:8378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b448da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f03 expref: 13 pid: 9995 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.547851:0:8378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b448da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f03 expref: 13 pid: 9995 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.547874:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b448da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f03 expref: 13 pid: 9995 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.547904:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096573.547910:0:8378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.547922:0:8378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.547932:0:8378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.547967:0:8378:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096573.547982:0:8378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fab3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8378:1873906360287872:0@lo:105: 00000100:00100000:3.0:1787096573.548029:0:8378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096573.548073:0:8378:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d58a74000 going to sleep for 11 seconds 00000100:00100000:2.0:1787096573.548121:0:7402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360287872 00000100:00100000:2.0:1787096573.548126:0:7402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360287872 00000100:00100000:2.0:1787096573.548166:0:7402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787096573.548179:0:7402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8378:x1873906360287872:12345-0@lo:105: 00010000:00010000:2.0:1787096573.548189:0:7402:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.548199:0:7402:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.548208:0:7402:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.548216:0:7402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.548223:0:7402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.548231:0:7402:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.548258:0:7402:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c9c42a60600) 00000100:00100000:2.0:1787096573.548293:0:7402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8378:x1873906360287872:12345-0@lo:105: Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096573.548301:0:7402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1787096573.548307:0:9995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.548320:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096573.548347:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787096573.548349:0:8378:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fab3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8378:1873906360287872:0@lo:105: 00010000:00010000:2.0:1787096573.548367:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096573.548386:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.548416:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.548431:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:2402:x1873906352890496:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 618us (1300us total) trans 0 rc 0/0 00010000:00010000:3.0:1787096573.548432:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.548445:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00100000:3.0:1787096573.548458:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fab0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288000:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787096573.548490:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096573.548511:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d58a74000 going to sleep for 11 seconds 00000100:00100000:3.0:1787096573.548532:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360288000 00000100:00100000:3.0:1787096573.548536:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360288000 00000100:00100000:3.0:1787096573.548574:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787096573.548582:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:9995:x1873906360288000:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096573.548601:0:7723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096573.548615:0:7723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44d6b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b44d64 expref: -99 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.548635:0:7723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44d6b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d64 expref: 10 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.548648:0:7723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44d6b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d64 expref: 10 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.548656:0:7723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffff9c9d46811200) 00010000:00010000:3.0:1787096573.548659:0:7723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096573.548662:0:7723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2a00, rc 0) 00000100:00100000:3.0:1787096573.548698:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:9995:x1873906360288000:12345-0@lo:101:mdt00_004.0 Request processed in 118us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096573.548716:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787096573.548737:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fab0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288000:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096573.548748:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.548757:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096573.548769:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787096573.548806:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288128:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096573.548836:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096573.548865:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42bcb600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096573.548909:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360288128 00000100:00100000:3.0:1787096573.548919:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360288128 00000100:00100000:3.0:1787096573.548976:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787096573.548983:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9995:x1873906360288128:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096573.549062:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9995:x1873906360288128:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096573.549069:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787096573.549112:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288128:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096573.549154:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288256:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096573.549176:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096573.549261:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42bcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096573.549290:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360288256 00000100:00100000:0.0:1787096573.549294:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360288256 00000100:00100000:0.0:1787096573.549330:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787096573.549338:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9995:x1873906360288256:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787096573.549468:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9995:x1873906360288256:12345-0@lo:1000:mdt00_004.0 Request processed in 131us (290us total) trans 0 rc 1/1 00000100:00100000:0.0:1787096573.549475:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787096573.549508:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288256:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787096573.549545:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549553:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549567:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096573.549578:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288384:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1787096573.549602:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096573.549623:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e78180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096573.549645:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360288384 00000100:00100000:2.0:1787096573.549650:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360288384 00000100:00100000:2.0:1787096573.549687:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787096573.549698:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:9995:x1873906360288384:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096573.549717:0:7723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096573.549731:0:7723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44d79 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b44d72 expref: -99 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.549749:0:7723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44d79 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d72 expref: 11 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.549761:0:7723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44d79 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d72 expref: 11 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.549774:0:7723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9c9c42964700) 00010000:00010000:2.0:1787096573.549777:0:7723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096573.549780:0:7723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b400, rc 0) 00000100:00100000:2.0:1787096573.549827:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:9995:x1873906360288384:12345-0@lo:101:mdt00_004.0 Request processed in 132us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096573.549834:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787096573.549897:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288384:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787096573.549909:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549917:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549942:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549952:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549961:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549977:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549988:0:9995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44912 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f18 expref: 6 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.549996:0:9995:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.550021:0:9995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f18 expref: 6 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.550035:0:9995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f18 expref: 6 pid: 18819 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096573.550048:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9995:1873906360288512:192.168.203.27@tcp:104: 00000100:00100000:0.0:1787096573.550100:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e78180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096573.551901:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9995:1873906360288512:192.168.203.27@tcp:104: 00010000:00010000:2.0:1787096573.551926:0:9995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.552470:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096573.552516:0:6465:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352890624 00000100:00100000:1.0:1787096573.552522:0:6465:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352890624 00010000:00010000:1.0:1787096573.552554:0:6465:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f18 expref: 7 pid: 18819 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096573.552584:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:1.0:1787096573.552592:0:6465:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:2402:x1873906352890624:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096573.552604:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096573.552608:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f18 expref: 7 pid: 18819 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.552619:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f18 expref: 7 pid: 18819 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.552636:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44912 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6f18 expref: 7 pid: 18819 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.552646:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffff9c9d6b3e8700) 00010000:00010000:1.0:1787096573.552650:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.552664:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.552669:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.552688:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096573.552714:0:9995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.552722:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096573.552748:0:6465:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2402:x1873906352890624:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 155us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096573.552756:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 111 00010000:00010000:2.0:1787096573.552760:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.552769:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.552779:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.552801:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc28380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288640:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787096573.552849:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096573.552881:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42bcbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096573.552900:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360288640 00000100:00100000:1.0:1787096573.552905:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360288640 00000100:00100000:1.0:1787096573.552941:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787096573.552948:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:9995:x1873906360288640:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787096573.552971:0:7409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096573.552988:0:7409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b44d8e expref: -99 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.553018:0:7409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d8e expref: 12 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.553030:0:7409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44d8e expref: 12 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.553037:0:7409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9c9c41286500) 00010000:00010000:1.0:1787096573.553041:0:7409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096573.553043:0:7409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce000, rc 0) 00000100:00100000:1.0:1787096573.553096:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:9995:x1873906360288640:12345-0@lo:101:mdt00_004.0 Request processed in 148us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096573.553113:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc28380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288640:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787096573.553115:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00010000:2.0:1787096573.553131:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.553140:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.553868:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc28380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288768:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1787096573.553918:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096573.553946:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42bcbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096573.553961:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360288768 00000100:00100000:3.0:1787096573.553967:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360288768 00000100:00100000:3.0:1787096573.554005:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787096573.554013:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:9995:x1873906360288768:12345-0@lo:403:mdt00_004.0 00000100:00100000:3.0:1787096573.555923:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:9995:x1873906360288768:12345-0@lo:403:mdt00_004.0 Request processed in 1905us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096573.555935:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787096573.556096:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc28380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360288768:0@lo:403:mdt00_004.0 00000040:00080000:2.0:1787096573.557152:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].11, 936 off48552 00000040:00080000:2.0:1787096573.557337:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].11, 1016 off50032 00000004:00080000:2.0:1787096573.557343:0:9995:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42bcbcc0 with version 22 00000004:00080000:0.0:1787096573.557496:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 22 rpc_version 22 00000020:00100000:0.0:1787096573.557534:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096573.557546:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d75982680 x1873906360289024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2336/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096573.557573:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75982680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360289024:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096573.557638:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096573.557674:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e78840 going to sleep for 11 seconds 00000100:00100000:2.0:1787096573.557694:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289024 00000100:00100000:2.0:1787096573.557715:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289024 00000100:00100000:2.0:1787096573.557770:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787096573.557782:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:7407:x1873906360289024:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096573.558279:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7407:x1873906360289024:12345-0@lo:1000:osp_up0-1.0 Request processed in 498us (639us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787096573.558289:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787096573.558348:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75982680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360289024:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1787096573.558433:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787096573.558458:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558469:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558489:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558496:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9c42a61400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096573.558502:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558511:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558530:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffff9c9d6b3e8700) 00010000:00010000:2.0:1787096573.558534:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096573.558539:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558561:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61400/0x1b9fb40e15b44d87 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558587:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558597:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558605:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558631:0:9995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096573.558639:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x8:0x0] 00010000:00010000:2.0:1787096573.558648:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.558653:0:6468:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096573.558664:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558665:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558684:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.558685:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ac00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:2.0:1787096573.558693:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9c42a61e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096573.558694:0:6468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558699:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096573.558724:0:6468:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558726:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558737:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9c9d48c60200) 00010000:00010000:2.0:1787096573.558743:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096573.558747:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558754:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9c42a61e00/0x1b9fb40e15b44d80 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.558769:0:6468:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558772:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.558785:0:6468:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096573.558788:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558797:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.558819:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 1/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.558828:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44d8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d95 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558832:0:9995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787096573.558834:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360289152:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1787096573.558846:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787096573.558852:0:6468:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096573.558857:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096573.558857:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558867:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.558867:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9c42a60e00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096573.558874:0:6468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558882:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096573.558886:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787096573.558896:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096573.558903:0:6468:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558923:0:9995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096573.558928:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787096573.558931:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096573.558932:0:6468:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.558935:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.558940:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096573.558949:0:6466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289152 00010000:00010000:0.0:1787096573.558955:0:6468:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787096573.558957:0:6466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289152 00010000:00010000:2.0:1787096573.558961:0:9995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.558964:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9c42a60600 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096573.558972:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 1/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.558973:0:8376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096573.558993:0:8376:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.559015:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60e00/0x1b9fb40e15b44d72 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d79 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.559033:0:8376:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096573.559035:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096573.559040:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096573.559042:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:39009:x1873906352890368:12345-192.168.203.27@tcp:36:rm.0 Request processed in 16499us (17219us total) trans 4294967360 rc 0/0 00010000:00010000:0.0:1787096573.559044:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096573.559049:0:8376:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787096573.559054:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 352 00000100:00100000:1.0:1787096573.559064:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787096573.559064:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360289280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096573.559076:0:6466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5257d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3627:x1873906360289152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096573.559087:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.559088:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360289408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096573.559101:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9c42a60600/0x1b9fb40e15b44d56 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d5d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096573.559104:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787096573.559105:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096573.559121:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096573.559124:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096573.559127:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44d95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b44d8e expref: 13 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096573.559128:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096573.559139:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096573.559151:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9c9c41286500) 00010000:00010000:1.0:1787096573.559162:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096573.559163:0:7855:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289280 00000100:00100000:0.0:1787096573.559169:0:7855:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289280 00000100:00100000:2.0:1787096573.559193:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289408 00000100:00100000:2.0:1787096573.559204:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289408 00000100:00100000:1.0:1787096573.559205:0:6466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5257d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3627:x1873906360289152:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096573.559210:0:7855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787096573.559219:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787096573.559225:0:7855:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3628:x1873906360289280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096573.559235:0:7855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787096573.559243:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1787096573.559252:0:7855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44d79 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b44d72 expref: 13 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096573.559256:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3625:x1873906360289408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096573.559271:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096573.559274:0:7855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff9c9c42964700) 00010000:00010000:0.0:1787096573.559283:0:7855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096573.559287:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b44d5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b44d56 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096573.559300:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096573.559304:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096573.559332:0:7855:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3628:x1873906360289280:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096573.559340:0:7855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787096573.559356:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3625:x1873906360289408:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096573.559364:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787096573.559383:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360289280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096573.559430:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360289408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096573.559443:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360289152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096573.646636:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360289536:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787096573.646648:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096573.646648:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360289664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096573.646732:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096573.646795:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289536 00000100:00100000:1.0:1787096573.646804:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096573.646805:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289536 00000100:00100000:3.0:1787096573.646869:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289664 00000100:00080000:1.0:1787096573.646874:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096573.646879:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289664 00000100:00100000:2.0:1787096573.646889:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787096573.646903:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360289536:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787096573.646931:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787096573.646948:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25042624 pending 1073152 free 3921956864 avail 3690434560 00000100:00100000:3.0:1787096573.646959:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787096573.646974:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3627:x1873906360289664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096573.647001:0:8362:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25042624 pending 1073152 free 3921956864 avail 3690434560 00000100:00100000:2.0:1787096573.647020:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360289536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096573.647031:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787096573.647065:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360289536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096573.647096:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3627:x1873906360289664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096573.647103:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787096573.647145:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360289664:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096574.149990:0:23983:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 19:42:54 (1787096574) 00000100:00100000:0.0:1787096574.594528:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096574.594587:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096574.594644:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096574.594708:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096574.594767:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096574.594810:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352890752 00000100:00100000:0.0:1787096574.594822:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352890752 00000100:00100000:0.0:1787096574.594909:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 335 00000100:00100000:0.0:1787096574.594926:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2402:x1873906352890752:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096574.594964:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891008 00000100:00100000:3.0:1787096574.594974:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891008 00000100:00100000:0.0:1787096574.595014:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2402:x1873906352890752:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 92us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096574.595025:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 335 00000100:00100000:3.0:1787096574.595054:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352890880 00000100:00100000:3.0:1787096574.595059:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352890880 00000100:00100000:0.0:1787096574.595077:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891264 00000100:00100000:0.0:1787096574.595082:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891264 00000100:00100000:3.0:1787096574.595089:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:3.0:1787096574.595100:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2402:x1873906352891008:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1787096574.595111:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00100000:0.0:1787096574.595120:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891136 00000100:00100000:0.0:1787096574.595125:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891136 00000100:00100000:2.0:1787096574.595138:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:2402:x1873906352890880:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096574.595147:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2402:x1873906352891008:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 45us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096574.595169:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:0.0:1787096574.595176:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:1.0:1787096574.595188:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:0.0:1787096574.595195:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:2402:x1873906352891264:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1787096574.595204:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:2402:x1873906352891136:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1787096574.595241:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:2402:x1873906352891264:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 53us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096574.595249:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:2402:x1873906352891136:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 50us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096574.595251:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:1.0:1787096574.595263:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00080000:0.0:1787096574.595487:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787096574.595492:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096574.595611:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:2402:x1873906352890880:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 485us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096574.595633:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 255 00010000:00010000:3.0:1787096574.670491:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096574.724842:0:24031:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27b needs >= 8 OSTs 00000001:02000400:0.0:1787096575.323528:0:24080:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27c: test creating with n+2 OSTs ======= 19:42:55 (1787096575) 00000100:00100000:1.0:1787096575.694625:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787096575.694629:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096575.694662:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360289792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096575.694771:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096575.694832:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289792 00000100:00100000:3.0:1787096575.694844:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289792 00000100:00100000:3.0:1787096575.694923:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787096575.694936:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3627:x1873906360289792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787096575.694979:0:6484:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:3.0:1787096575.695041:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3627:x1873906360289792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096575.695048:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787096575.695152:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360289792:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787096575.898254:0:24128:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27c needs >= 8 OSTs 00000004:00080000:1.0:1787096576.206644:0:9796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 251871246570ns, next at 252871242484ns, rc = 0 00000100:00100000:1.0:1787096576.206710:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d512d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360289920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096576.206801:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096576.206888:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787096576.206900:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360290048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096576.206909:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360289920 00000100:00100000:3.0:1787096576.206922:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360289920 00000100:00100000:1.0:1787096576.206941:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096576.207017:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360290176:0@lo:400:kworker.0 00000100:00100000:3.0:1787096576.207019:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290048 00000100:00100000:3.0:1787096576.207025:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290048 00000100:00100000:0.0:1787096576.207045:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787096576.207071:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096576.207081:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3625:x1873906360289920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096576.207113:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00002000:00000024:0.0:1787096576.207126:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 548864 free 3923005440 avail 3691483136 00000100:00100000:1.0:1787096576.207132:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360290688:0@lo:400:kworker.0 00000100:00100000:3.0:1787096576.207138:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360290048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096576.207161:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 548864 free 3923005440 avail 3691483136 00000100:00100000:1.0:1787096576.207170:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096576.207226:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360291200:0@lo:400:kworker.0 00000100:00100000:0.0:1787096576.207236:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3625:x1873906360289920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096576.207238:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360290048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096576.207256:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787096576.207259:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290176 00000100:00100000:3.0:1787096576.207267:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787096576.207276:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096576.207293:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290176 00000100:00080000:0.0:1787096576.207308:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787096576.207326:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787096576.207338:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906360290304:0@lo:400:kworker.0 00000100:00100000:0.0:1787096576.207351:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290688 00000100:00100000:0.0:1787096576.207358:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290688 00000100:00100000:2.0:1787096576.207364:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787096576.207376:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096576.207380:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360290176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.207467:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360290176:12345-0@lo:400:kworker.0 Request processed in 91us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096576.207477:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787096576.207477:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906360290816:0@lo:400:kworker.0 00000100:00100000:0.0:1787096576.207488:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360291200 00000100:00100000:0.0:1787096576.207493:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360291200 00000100:00100000:3.0:1787096576.207521:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290304 00000100:00100000:1.0:1787096576.207522:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096576.207532:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290304 00000100:00100000:0.0:1787096576.207545:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290816 00000100:00100000:0.0:1787096576.207550:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290816 00000100:00100000:1.0:1787096576.207565:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906360291328:0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.207572:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787096576.207582:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787096576.207587:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360290688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096576.207600:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096576.207607:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360291200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096576.207611:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787096576.207639:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906360290304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.207654:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360290688:12345-0@lo:400:kworker.0 Request processed in 71us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096576.207664:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787096576.207676:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360290688:0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.207703:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360291328 00000100:00100000:2.0:1787096576.207708:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360291328 00000100:00100000:2.0:1787096576.207733:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787096576.207739:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906360290816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096576.208215:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360290176:0@lo:400:kworker.0 00000100:00100000:3.0:1787096576.208226:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360291200:12345-0@lo:400:kworker.0 Request processed in 622us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096576.208226:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906360290304:12345-0@lo:400:kworker.0 Request processed in 594us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096576.208253:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787096576.208254:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906360290816:12345-0@lo:400:kworker.0 Request processed in 501us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096576.208263:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906360290304:0@lo:400:kworker.0 00000100:00100000:3.0:1787096576.208264:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787096576.208283:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787096576.208291:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787096576.208297:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906360290816:0@lo:400:kworker.0 00000100:00100000:0.0:1787096576.208312:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906360291328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096576.208323:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360291200:0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.208386:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360290560:0@lo:400:kworker.0 00000100:00100000:0.0:1787096576.208388:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906360291328:12345-0@lo:400:kworker.0 Request processed in 84us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096576.208433:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787096576.208437:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906360291328:0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.208462:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787096576.208486:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787096576.208497:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096576.208498:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360291072:0@lo:400:kworker.0 00000100:00100000:1.0:1787096576.208504:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290560 00000100:00100000:1.0:1787096576.208511:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290560 00000100:00100000:3.0:1787096576.208540:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1873906360290432:0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.208548:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096576.208571:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787096576.208587:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360290560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.208590:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360291072 00000100:00100000:2.0:1787096576.208601:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360291072 00000100:00100000:3.0:1787096576.208614:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096576.208651:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787096576.208662:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1873906360291072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096576.208670:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360290560:12345-0@lo:400:kworker.0 Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096576.208672:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360290944:0@lo:400:kworker.0 00000100:00100000:1.0:1787096576.208697:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787096576.208715:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1873906360291072:12345-0@lo:400:kworker.0 Request processed in 54us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096576.208721:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787096576.208731:0:3626:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:1.0:1787096576.208737:0:3626:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967350 committed transno 4294967355 00000100:00100000:3.0:1787096576.208742:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787096576.208757:0:3626:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967351 committed transno 4294967355 00000020:00080000:1.0:1787096576.208763:0:3626:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9c42ca4c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787096576.208767:0:3626:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c41ded500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42ca4540 00000100:00100000:2.0:1787096576.208770:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290432 00000020:00080000:1.0:1787096576.208770:0:3626:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].8 00000020:00080000:1.0:1787096576.208775:0:3626:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c41ded000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d6e80f200 00000100:00100000:2.0:1787096576.208778:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290432 00000020:00080000:1.0:1787096576.208778:0:3626:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].8 00000004:00080000:1.0:1787096576.208802:0:3626:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967353 committed transno 4294967355 00000100:00100000:3.0:1787096576.208810:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360290048:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1787096576.208819:0:3626:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967354 committed transno 4294967355 00000100:00100000:2.0:1787096576.208823:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787096576.208838:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1873906360290432:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1787096576.208840:0:3626:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967355 committed transno 4294967355 00000100:00100000:3.0:1787096576.208847:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d512d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360289920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096576.208871:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360290560:0@lo:400:kworker.0 00000100:00100000:1.0:1787096576.208902:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360291072:0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.208911:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1873906360290432:12345-0@lo:400:kworker.0 Request processed in 71us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096576.208916:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1873906360290432:0@lo:400:kworker.0 00000100:00100000:2.0:1787096576.208929:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00080000:1.0:1787096576.208931:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000100:00100000:3.0:1787096576.208968:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360290944 00000100:00100000:3.0:1787096576.208975:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360290944 00000020:00080000:1.0:1787096576.209001:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1787096576.209026:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787096576.209036:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360290944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096576.209092:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360290944:12345-0@lo:400:kworker.0 Request processed in 58us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096576.209099:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787096576.209155:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360290944:0@lo:400:kworker.0 00000100:00080000:0.0:1787096576.209204:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787096576.521296:0:24176:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 19:42:56 (1787096576) 00010000:00010000:0.0:1787096576.718611:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096577.053782:0:24224:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27d needs >= 8 OSTs 00000100:00100000:0.0:1787096577.230631:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360291456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787096577.230728:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096577.230836:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360291456 00000100:00100000:0.0:1787096577.230846:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360291456 00000100:00100000:0.0:1787096577.230901:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787096577.230911:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360291456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787096577.230947:0:7723:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1787096577.230992:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360291456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096577.231000:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787096577.231042:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360291456:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787096577.231738:0:9426:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787096577.231747:0:8354:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1787096577.231755:0:9426:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787096577.231769:0:8354:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000020:00080000:0.0:1787096577.232154:0:6459:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000004:00080000:0.0:1787096577.232170:0:6459:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:0.0:1787096577.232183:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000020:00080000:1.0:1787096577.232194:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787096577.232207:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000004:00080000:0.0:1787096577.232211:0:6459:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787096577.232222:0:6459:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:3.0:1787096577.232253:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096577.232261:0:6511:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9c41ae8e40 with version 19 00010000:00010000:3.0:1787096577.232268:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096577.232276:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8 cancel update log [0x240000401:0x3:0x0].8: rc = 0 00010000:00010000:3.0:1787096577.232278:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096577.232287:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cfe00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096577.232292:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096577.232300:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 19 rpc_version 19 00000100:00100000:2.0:1787096577.232312:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360291584:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787096577.232314:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096577.232324:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096577.232333:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42cce680 x1873906360292096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1787096577.232336:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0xc0870d27 (ffff9c9d6b3f4000) 00010000:00010000:3.0:1787096577.232344:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1787096577.232349:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8 cancel update log [0x200000400:0x3:0x0].8: rc = 0 00010000:00010000:3.0:1787096577.232352:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096577.232357:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787096577.232360:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42cce680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360292096:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787096577.232361:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44d41 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096577.232363:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096577.232373:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360291712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787096577.232436:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096577.232440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096577.232461:0:8580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360291584 00000100:00100000:3.0:1787096577.232466:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360291840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787096577.232467:0:8580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360291584 00000100:00100000:0.0:1787096577.232473:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e78b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096577.232499:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360292096 00000100:00100000:3.0:1787096577.232503:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096577.232513:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360291712 00000100:00100000:1.0:1787096577.232514:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360292096 00000100:00100000:0.0:1787096577.232518:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360291712 00000100:00100000:2.0:1787096577.232520:0:8580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360291840 00000100:00100000:2.0:1787096577.232527:0:8580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360291840 00000100:00100000:1.0:1787096577.232559:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787096577.232563:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787096577.232571:0:8580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787096577.232573:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360292096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096577.232576:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1873906360291584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787096577.232584:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787096577.232586:0:8580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360291712:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787096577.232598:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1873906360291840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787096577.232603:0:8361:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00080000:2.0:1787096577.232604:0:8580:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00080000:3.0:1787096577.232614:0:8360:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1787096577.232637:0:8360:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1787096577.232638:0:8580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 3145728, mtime: 0x6a84edfc, atime: 0x0, ctime: 0x6a84edfc, blocks: 0x800 00002000:00010000:0.0:1787096577.232638:0:8361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 524288, mtime: 0x6a84edfc, atime: 0x6a84edfb, ctime: 0x6a84edfc, blocks: 0x400 00010000:00010000:3.0:1787096577.232645:0:8360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096577.232650:0:8361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232651:0:8580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096577.232658:0:8360:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096577.232661:0:8360:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096577.232668:0:8360:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096577.232690:0:8361:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1787096577.232693:0:8361:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096577.232696:0:8580:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1787096577.232698:0:8361:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232699:0:8580:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096577.232704:0:8360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232705:0:8580:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096577.232717:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1873906360292096:12345-0@lo:1000:osp_up1-0.0 Request processed in 145us (282us total) trans 4294967361 rc 0/0 00010000:00010000:0.0:1787096577.232718:0:8361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232734:0:8580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096577.232735:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00010000:0.0:1787096577.232745:0:8361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096577.232752:0:8360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232758:0:8580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096577.232769:0:8361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096577.232775:0:8360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232782:0:8580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096577.232805:0:8361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787096577.232812:0:8360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1787096577.232816:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42cce680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360292096:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787096577.232820:0:8580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787096577.232842:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787096577.232848:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096577.232868:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9c42a60e00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:1.0:1787096577.232872:0:8376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096577.232878:0:8376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096577.232889:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096577.232895:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cdb1af1/0x1b9fb40e15b44da3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096577.232914:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787096577.232917:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096577.232924:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2e00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:1.0:1787096577.232928:0:8376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096577.232937:0:8580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1873906360291712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 354us (500us total) trans 4294967309 rc 0/0 00010000:00010000:1.0:1787096577.232938:0:8376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096577.232949:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1873906360291584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 376us (588us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787096577.232956:0:8580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787096577.232960:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3628:x1873906360291840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 364us (456us total) trans 4294967309 rc 0/0 00010000:00010000:1.0:1787096577.232967:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096577.232967:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787096577.232973:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:2.0:1787096577.232982:0:7403:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096577.232982:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e28115/0x1b9fb40e15b44d9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232988:0:7403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096577.232995:0:7403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ae00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:2.0:1787096577.232998:0:7403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096577.233001:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096577.233003:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096577.233006:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096577.233007:0:3626:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00010000:00010000:1.0:1787096577.233011:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787096577.233015:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9d58843b80, transno 4294967303 00010000:00010000:2.0:1787096577.233020:0:7403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096577.233027:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9c42cb2680, transno 4294967305 00010000:00010000:2.0:1787096577.233031:0:7403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096577.233033:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9d7fc2a680, transno 4294967306 00000004:00080000:0.0:1787096577.233039:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9d7fc2b480, transno 4294967307 00010000:00010000:2.0:1787096577.233040:0:7403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf41694/0x1b9fb40e15b44daa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096577.233048:0:3626:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9c42d08000 x1873906360291584/t4294967308(4294967308) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096593 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096577.233051:0:3627:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00010000:00010000:2.0:1787096577.233053:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096577.233056:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096577.233058:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787096577.233059:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9c42fa4380, transno 4294967305 00000004:00080000:0.0:1787096577.233065:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9c42d08000/2, rc 0, transno 4294967308 00000004:00080000:3.0:1787096577.233067:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9c42d0a680/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787096577.233074:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360291840:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787096577.233076:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9d7fab0e00, transno 4294967306 00000100:00100000:0.0:1787096577.233081:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360291584:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787096577.233083:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9d57c26680, transno 4294967307 00000100:00100000:1.0:1787096577.233093:0:3627:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9c42ccd500 x1873906360291712/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096593 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787096577.233110:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9c42ccd500/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787096577.233117:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360291712:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787096577.233139:0:9795:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 4 done 00000004:00080000:3.0:1787096577.233152:0:8575:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 1 in progress, 0 in flight, 3 done 00000001:02000400:1.0:1787096577.628675:0:24272:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 19:42:57 (1787096577) 00010000:00010000:3.0:1787096577.742558:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096578.173554:0:24320:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27e needs >= 8 OSTs 00000100:00100000:1.0:1787096578.766528:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096578.766558:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360292224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096578.766645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096578.766721:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360292224 00000100:00100000:0.0:1787096578.766732:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360292224 00000100:00100000:0.0:1787096578.766813:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787096578.766826:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360292224:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787096578.766829:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787096578.766865:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923005440 avail 3691483136 00000100:00100000:0.0:1787096578.766929:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360292224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096578.766938:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787096578.767036:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360292224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096578.767541:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787096578.767555:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360292352:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787096578.767561:0:8576:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 254432165291ns, next at 255432161671ns, rc = 0 00010000:00010000:0.0:1787096578.767577:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096578.767594:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096578.767627:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360292352 00000100:00100000:0.0:1787096578.767633:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360292352 00000100:00080000:1.0:1787096578.767661:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096578.767688:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787096578.767701:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1873906360292352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096578.767715:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923005440 avail 3691483136 00000100:00100000:0.0:1787096578.767763:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1873906360292352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096578.767770:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787096578.767844:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360292352:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096578.776013:0:24368:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 19:42:59 (1787096579) 00010000:00010000:0.0:1787096579.279883:0:7392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096579.279903:0:7392:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.279946:0:7392:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.279951:0:7392:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096579.279983:0:7392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3400/0x1b9fb40e15b44d64 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b44d6b expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787096579.280005:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967361 is committed 00000001:00080000:0.0:1787096579.280017:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967360 is committed 00000100:00100000:1.0:1787096579.280025:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360292480:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1787096579.280033:0:7392:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 9 batchid updated 00000020:00080000:2.0:1787096579.280100:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00000100:00100000:1.0:1787096579.280106:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.280161:0:6466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360292480 00000100:00100000:3.0:1787096579.280169:0:6466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360292480 00000004:00080000:2.0:1787096579.280174:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9d50774cc0 with version 23 00000020:00080000:2.0:1787096579.280193:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 9 cancel update log [0x200000401:0x3:0x0].9: rc = 0 00000004:00080000:0.0:1787096579.280213:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 23 rpc_version 23 00000100:00100000:3.0:1787096579.280224:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787096579.280234:0:6466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3627:x1873906360292480:12345-0@lo:103:jbd2/dm-1-8.0 00000020:00100000:0.0:1787096579.280237:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096579.280245:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42cce300 x1873906360292736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1787096579.280247:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787096579.280262:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42cce300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360292736:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787096579.280266:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44d6b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b44d64 expref: 7 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096579.280279:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 9 cancel update log [0x240000400:0x3:0x0].9: rc = 0 00000020:00080000:2.0:1787096579.280289:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00010000:00010000:3.0:1787096579.280290:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffff9c9d46811200) 00000100:00100000:0.0:1787096579.280296:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096579.280302:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096579.280320:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096579.280332:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360292736 00000100:00100000:2.0:1787096579.280336:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360292736 00000100:00100000:3.0:1787096579.280352:0:6466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3627:x1873906360292480:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 118us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.280361:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787096579.280424:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787096579.280428:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360292480:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1787096579.280434:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7407:x1873906360292736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096579.280538:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360292736:12345-0@lo:1000:osp_up0-1.0 Request processed in 108us (243us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787096579.280549:0:7407:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967434 gen 2 00000100:00100000:2.0:1787096579.280552:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000004:00080000:1.0:1787096579.280553:0:7407:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967432 committed transno 4294967434 00000020:00080000:1.0:1787096579.280558:0:7407:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9c42bcb3c0 refcount 2 committed 0 result 0 batchid 10 00000020:00080000:1.0:1787096579.280561:0:7407:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c41e4ce00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42bcb840 00000020:00080000:1.0:1787096579.280563:0:7407:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].10 00000020:00080000:1.0:1787096579.280566:0:7407:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d7ca50600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42b9e000 00000020:00080000:1.0:1787096579.280567:0:7407:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].10 00000020:00080000:2.0:1787096579.280576:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 10 committed batchid 9 00000004:00080000:1.0:1787096579.280584:0:7407:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967433 committed transno 4294967434 00000020:00080000:2.0:1787096579.280595:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00000004:00080000:1.0:1787096579.280599:0:7407:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967434 committed transno 4294967434 00000020:00080000:1.0:1787096579.280602:0:7407:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9c42bcb600 refcount 2 committed 0 result 0 batchid 11 00000020:00080000:1.0:1787096579.280604:0:7407:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c41e4ca00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42bcbcc0 00000020:00080000:1.0:1787096579.280606:0:7407:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].11 00000020:00080000:1.0:1787096579.280607:0:7407:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c41e4c600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42b9f400 00000020:00080000:1.0:1787096579.280609:0:7407:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].11 00000100:00100000:1.0:1787096579.280625:0:7407:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9c42cce300 x1873906360292736/t4294967435(4294967435) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787096595 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096579.280637:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42cce300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360292736:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1787096579.280660:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 11 committed batchid 9 00000020:00080000:2.0:1787096579.280687:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00000001:02000400:2.0:1787096579.345628:0:24416:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27f needs >= 8 OSTs 00000100:00100000:1.0:1787096579.714559:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096579.714622:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096579.714634:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891392 00000100:00100000:3.0:1787096579.714648:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891392 00000100:00100000:2.0:1787096579.714679:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891648 00000100:00100000:1.0:1787096579.714684:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096579.714686:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891648 00000100:00100000:3.0:1787096579.714732:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 337 00000100:00100000:1.0:1787096579.714739:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096579.714745:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2401:x1873906352891392:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1787096579.714746:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 262 00000100:00100000:2.0:1787096579.714764:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352891648:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1787096579.714794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096579.714834:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891904 00000100:00100000:1.0:1787096579.714839:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891904 00000100:00100000:3.0:1787096579.714845:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2401:x1873906352891392:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.714845:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352891648:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.714866:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 262 00000100:00100000:3.0:1787096579.714867:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 337 00000100:00100000:1.0:1787096579.714887:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891776 00000100:00100000:1.0:1787096579.714892:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891776 00000100:00100000:2.0:1787096579.714893:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352891520 00000100:00100000:2.0:1787096579.714898:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352891520 00000100:00100000:1.0:1787096579.714946:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:3.0:1787096579.714952:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 263 00000100:00100000:1.0:1787096579.714959:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352891904:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096579.714972:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352891520:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1787096579.715015:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352891904:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 59us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.715023:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352891520:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.715025:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:3.0:1787096579.715036:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 263 00000100:00100000:1.0:1787096579.715052:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:1.0:1787096579.715062:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2401:x1873906352891776:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1787096579.715087:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2401:x1873906352891776:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00080000:3.0:1787096579.715092:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096579.715092:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00080000:3.0:1787096579.715100:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787096579.715105:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096579.715110:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787096579.790876:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096579.995941:0:24464:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 19:43:00 (1787096580) 00000100:00100000:3.0:1787096580.057117:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096580.057182:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352892032 00000100:00100000:2.0:1787096580.057197:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352892032 00000100:00100000:2.0:1787096580.057272:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 353 00000100:00100000:2.0:1787096580.057282:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:40658:x1873906352892032:12345-192.168.203.27@tcp:41:stat.0 00000004:00000024:2.0:1787096580.057341:0:9995:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7846010880 avail 7382417408 00000100:00100000:2.0:1787096580.057459:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:40658:x1873906352892032:12345-192.168.203.27@tcp:41:stat.0 Request processed in 178us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096580.057469:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 353 00000100:00100000:2.0:1787096580.080621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.080706:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352892160 00000100:00100000:3.0:1787096580.080734:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352892160 00000100:00100000:3.0:1787096580.080794:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 354 00000100:00100000:3.0:1787096580.080802:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:40666:x1873906352892160:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.080820:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.080840:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc704c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.080916:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.080933:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.080944:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096580.080997:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096580.081001:0:6481:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096580.081026:0:6481:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.081048:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc704c expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.081062:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc704c expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.081069:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096580.081072:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096580.081075:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2a00, rc 0) 00000100:00100000:3.0:1787096580.081144:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:40666:x1873906352892160:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 344us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096580.081150:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 354 00000100:00100000:1.0:1787096580.082808:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.082875:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352892288 00000100:00100000:3.0:1787096580.082885:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352892288 00000100:00100000:3.0:1787096580.082935:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 355 00000100:00100000:3.0:1787096580.082946:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:40666:x1873906352892288:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.082962:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.082974:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc7053 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083021:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083030:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083039:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083054:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083061:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083068:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083112:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083134:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083139:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083144:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083148:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096580.083151:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083156:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083165:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096580.083167:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096580.083170:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083173:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44dc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083183:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083187:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083191:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083197:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096580.083199:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083202:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083206:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff9c9d46811200) 00010000:00010000:3.0:1787096580.083208:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096580.083209:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083212:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44dcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083240:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44dbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7053 expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083247:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096580.083248:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096580.083250:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7053 expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.083255:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2800, rc 0) 00000100:00100000:3.0:1787096580.083298:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:40666:x1873906352892288:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 355us (497us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096580.083303:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 355 00000100:00100000:0.0:1787096580.085539:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096580.085602:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352892544 00000100:00100000:2.0:1787096580.085615:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352892544 00000100:00100000:2.0:1787096580.085696:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 356 00000100:00100000:2.0:1787096580.085708:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:40666:x1873906352892544:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:2.0:1787096580.085773:0:9995:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096580.085798:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc704c expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.085817:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096580.085822:0:9995:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096580.085874:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.085901:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.085911:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.085935:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44ddb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.085943:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44ddb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.085949:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44ddb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787096580.086720:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].9, 2152 off47272 00000040:00080000:2.0:1787096580.086793:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].9, 2352 off48592 00000004:00080000:2.0:1787096580.086800:0:9995:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9d525de480 with version 20 00000004:00080000:1.0:1787096580.086834:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 20 rpc_version 20 00000020:00100000:1.0:1787096580.086889:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096580.086899:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d57c24e00 x1873906360292992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096580.086921:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c24e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360292992:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096580.086979:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096580.087027:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360292992 00000100:00100000:2.0:1787096580.087033:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360292992 00000100:00100000:1.0:1787096580.087039:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e45c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096580.087083:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787096580.087092:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360292992:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096580.087419:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1873906360292992:12345-0@lo:1000:osp_up1-0.0 Request processed in 327us (437us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787096580.087429:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787096580.087465:0:7720:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:1.0:1787096580.087471:0:7720:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967361 committed transno 4294967361 00000100:00100000:1.0:1787096580.087493:0:7720:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9d57c24e00 x1873906360292992/t4294967362(4294967362) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 1787096596 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096580.087544:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c24e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360292992:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787096580.087710:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44de2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087725:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44de2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087747:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44de2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087768:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44de9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087776:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44de9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087783:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44de9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087812:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087821:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.087830:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096580.087840:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9995:1873906360293120:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787096580.087870:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096580.087902:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d589520c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096580.087921:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360293120 00000100:00100000:3.0:1787096580.087934:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360293120 00000100:00100000:3.0:1787096580.087965:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787096580.087977:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9995:x1873906360293120:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096580.087989:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.088004:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b44df7 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b44df0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.088021:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b44df7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b44df0 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.088036:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b44df7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44df0 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.088044:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff9c9d46811300) 00010000:00010000:3.0:1787096580.088047:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096580.088049:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3200, rc 0) 00000100:00100000:3.0:1787096580.088114:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9995:x1873906360293120:12345-0@lo:101:mdt00_004.0 Request processed in 138us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096580.088123:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787096580.088128:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9995:1873906360293120:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096580.088149:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088161:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096580.088181:0:9995:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002efb370e reply state 0000000084abd6e0 transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44de9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088191:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44de9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088196:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff9c9c42964300) 00010000:00010000:2.0:1787096580.088198:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096580.088201:0:9995:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096580.088206:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088211:0:9995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096580.088218:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000004:00010000:2.0:1787096580.088223:0:9995:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002efb370e reply state 0000000084abd6e0 transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44de2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088227:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44de2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088240:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9c9c42964c00) 00010000:00010000:2.0:1787096580.088241:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096580.088243:0:9995:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787096580.088247:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:2.0:1787096580.088253:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088257:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088261:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088265:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088270:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4be00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096580.088275:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088281:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088291:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096580.088294:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096580.088297:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088303:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b44dd4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096580.088317:0:9995:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002efb370e reply state 0000000084abd6e0 transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44ddb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088332:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44ddb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.088338:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff9c9c42964d00) 00010000:00010000:2.0:1787096580.088341:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096580.088342:0:9995:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787096580.088460:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:40666:x1873906352892544:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 2751us (2925us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787096580.088468:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 356 00000100:00100000:2.0:1787096580.102107:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.102176:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352892672 00000100:00100000:3.0:1787096580.102187:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352892672 00000100:00100000:3.0:1787096580.102238:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 357 00000100:00100000:3.0:1787096580.102246:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:40669:x1873906352892672:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.102268:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.102287:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc705a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.102345:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44e05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.102371:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44e05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.102382:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44e05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096580.102478:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096580.102482:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096580.102502:0:6479:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44e05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.102526:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc705a expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.102546:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44e05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc705a expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.102555:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096580.102558:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096580.102562:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3e00, rc 0) 00000100:00100000:3.0:1787096580.102625:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:40669:x1873906352892672:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 379us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096580.102633:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 357 00000100:00100000:0.0:1787096580.104303:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.104343:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352892800 00000100:00100000:3.0:1787096580.104355:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352892800 00000100:00100000:3.0:1787096580.104448:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 358 00000100:00100000:3.0:1787096580.104459:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:40669:x1873906352892800:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.104479:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.104507:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44e0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc7061 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104579:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104591:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104599:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104606:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104610:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104614:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104713:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44e21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104722:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44e21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104729:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44e21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096580.104830:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000004:00200000:3.0:1787096580.104836:0:18819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787096580.104854:0:18819:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44e21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104869:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104874:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104879:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104883:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104886:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096580.104890:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104894:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104903:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096580.104904:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096580.104908:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104911:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104922:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104926:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104933:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104936:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096580.104937:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104941:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104945:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff9c9c42964d00) 00010000:00010000:3.0:1787096580.104946:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096580.104948:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104951:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104980:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44e0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7061 expref: 10 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104993:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44e21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7061 expref: 9 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.104999:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9c9c42964c00) 00010000:00010000:3.0:1787096580.105001:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787096580.105004:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2a00, rc 0) 00000100:00100000:3.0:1787096580.105062:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:40669:x1873906352892800:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 604us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096580.105079:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 358 00000100:00100000:0.0:1787096580.106302:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.106364:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352892928 00000100:00100000:3.0:1787096580.106375:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352892928 00000100:00100000:3.0:1787096580.106435:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 359 00000100:00100000:3.0:1787096580.106442:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:40669:x1873906352892928:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.106458:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.106471:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b44e28 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc7068 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.106519:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44e2f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.106531:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44e2f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.106548:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44e2f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096580.106579:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787096580.106583:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096580.106606:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b44e28 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7068 expref: 11 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.106633:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44e2f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7068 expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.106640:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff9c9c42964300) 00010000:00010000:3.0:1787096580.106642:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096580.106651:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2e00, rc 0) 00000100:00100000:3.0:1787096580.106704:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:40669:x1873906352892928:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 262us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096580.106709:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 359 00000100:00100000:2.0:1787096580.107700:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.107725:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352893056 00000100:00100000:3.0:1787096580.107733:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352893056 00000100:00100000:3.0:1787096580.107769:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 360 00000100:00100000:3.0:1787096580.107778:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:40669:x1873906352893056:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.107790:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.107804:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44e36 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc706f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.107843:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.107857:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b44df7 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44df0 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.107866:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.107900:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b44df7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b9fb40e15b44df0 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096580.107916:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6479:1873906360293248:0@lo:104: 00000100:00100000:3.0:1787096580.107963:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096580.108021:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e9f8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787096580.108080:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787096580.108099:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360293248 00000100:00100000:1.0:1787096580.108103:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360293248 00000100:00100000:1.0:1787096580.108169:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787096580.108177:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d45967c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6479:x1873906360293248:12345-0@lo:104: 00010000:00010000:1.0:1787096580.108190:0:6464:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096580.108247:0:6464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096580.108254:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d45967c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6479:x1873906360293248:12345-0@lo:104: Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096580.108261:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787096580.108269:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6479:1873906360293248:0@lo:104: 00010000:00010000:0.0:1787096580.108279:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096580.108287:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.108291:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.108298:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4aa00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096580.108305:0:8376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096580.108314:0:8376:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.108344:0:8376:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.108370:0:8376:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096580.108426:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.108434:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44df0 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44df7 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096580.108439:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360293376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096580.108453:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096580.108455:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096580.108457:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096580.108469:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096580.108535:0:9435:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360293376 00000100:00100000:0.0:1787096580.108539:0:9435:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360293376 00010000:00010000:0.0:1787096580.108559:0:9435:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b44df7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b9fb40e15b44df0 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096580.108586:0:9435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787096580.108593:0:9435:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3628:x1873906360293376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096580.108602:0:9435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787096580.109864:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967362 is committed 00000020:00080000:2.0:1787096580.109878:0:7392:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 11 batchid updated 00000020:00080000:2.0:1787096580.109883:0:7392:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 10 batchid updated 00000020:00080000:0.0:1787096580.109986:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00010000:00010000:1.0:1787096580.110038:0:9435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b44df7 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b9fb40e15b44df0 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096580.110061:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42d53540 with version 24 00010000:00010000:1.0:1787096580.110062:0:9435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff9c9d46811300) 00010000:00010000:1.0:1787096580.110071:0:9435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096580.110083:0:9435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096580.110091:0:9435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096580.110092:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 10 cancel update log [0x200000401:0x3:0x0].10: rc = 0 00000004:00080000:2.0:1787096580.110140:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 24 rpc_version 24 00010000:00010000:1.0:1787096580.110151:0:9435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00100000:2.0:1787096580.110183:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1787096580.110197:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 10 cancel update log [0x240000400:0x3:0x0].10: rc = 0 00000100:00100000:2.0:1787096580.110198:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42dc8000 x1873906360293632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096580.110230:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42dc8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360293632:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096580.110237:0:9435:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360293376:12345-0@lo:103:ldlm_bl.0 Request processed in 1642us (1765us total) trans 0 rc 0/0 00010000:00010000:3.0:1787096580.110242:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.110265:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096580.110266:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42d533c0 with version 25 00000100:00100000:1.0:1787096580.110272:0:9435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000020:00080000:0.0:1787096580.110280:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 11 cancel update log [0x200000401:0x3:0x0].11: rc = 0 00000100:00100000:2.0:1787096580.110292:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096580.110322:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360293632 00000020:00080000:0.0:1787096580.110322:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 11 cancel update log [0x240000400:0x3:0x0].11: rc = 0 00000100:00100000:2.0:1787096580.110325:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d589520c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096580.110330:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360293632 00000004:00200000:3.0:1787096580.110341:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000020:00080000:0.0:1787096580.110343:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00000004:00200000:3.0:1787096580.110348:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1787096580.110371:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787096580.110379:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360293632:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787096580.110436:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44e36 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc706f expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.110459:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44e3d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc706f expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.110465:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff9c9d46811300) 00010000:00010000:3.0:1787096580.110468:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096580.110470:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2c00, rc 0) 00000100:00100000:0.0:1787096580.110478:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360293376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787096580.110532:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:40669:x1873906352893056:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2753us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096580.110541:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 360 00000100:00100000:1.0:1787096580.110565:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7407:x1873906360293632:12345-0@lo:1000:osp_up0-1.0 Request processed in 187us (279us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787096580.110574:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787096580.110657:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42dc8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360293632:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787096580.110683:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 25 rpc_version 25 00000020:00100000:0.0:1787096580.110705:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096580.110713:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42ccf480 x1873906360293888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096580.110734:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360293888:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096580.110809:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096580.110844:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360293888 00000100:00100000:0.0:1787096580.110844:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096580.110849:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360293888 00000100:00100000:3.0:1787096580.110905:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787096580.110915:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d507ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7407:x1873906360293888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096580.111027:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d507ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7407:x1873906360293888:12345-0@lo:1000:osp_up0-1.0 Request processed in 114us (217us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787096580.111034:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787096580.111076:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360293888:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096580.112155:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096580.112210:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352893184 00000100:00100000:0.0:1787096580.112218:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352893184 00000100:00100000:0.0:1787096580.112263:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 361 00000100:00100000:0.0:1787096580.112272:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:40669:x1873906352893184:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096580.112287:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096580.112307:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60a00/0x1b9fb40e15b44e44 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc7076 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112369:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112388:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112423:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112440:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112458:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112465:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112531:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112539:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112546:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112553:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112558:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9c42a60200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096580.112562:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112570:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112580:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff9c9c42964300) 00010000:00010000:0.0:1787096580.112583:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096580.112587:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112593:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60200/0x1b9fb40e15b44e4b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112616:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112622:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112628:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112634:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9c42a61200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096580.112637:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112643:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112650:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xe0be4298 (ffff9c9d48c60f00) 00010000:00010000:0.0:1787096580.112652:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096580.112654:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112658:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a61200/0x1b9fb40e15b44e52 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112696:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60a00/0x1b9fb40e15b44e44 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7076 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112703:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff9c9c42964300) 00010000:00010000:0.0:1787096580.112704:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096580.112711:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9c42a60a00/0x1b9fb40e15b44e44 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7076 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096580.112718:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9c42a60a00, rc 0) 00000100:00100000:0.0:1787096580.112764:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:40669:x1873906352893184:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 493us (613us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096580.112771:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 361 00000100:00100000:2.0:1787096580.114471:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.114517:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352893440 00000100:00100000:3.0:1787096580.114529:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352893440 00000100:00100000:3.0:1787096580.114581:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 362 00000100:00100000:3.0:1787096580.114591:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:40669:x1873906352893440:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.114619:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.114622:0:9995:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787096580.114643:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44e2f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7068 expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.114674:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff9c9c42964300) 00010000:00010000:3.0:1787096580.114679:0:9995:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096580.114689:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44e59 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc707d expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.114787:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.114800:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.114810:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.114824:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e67 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.114832:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e67 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.114839:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e67 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115284:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115304:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115312:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096580.115323:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00010000:00010000:3.0:1787096580.115353:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115361:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115367:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115374:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115380:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096580.115384:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115426:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115436:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff9c9c42964300) 00010000:00010000:3.0:1787096580.115439:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096580.115444:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115450:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44e60 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096580.115472:0:9995:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009f68c301 reply state 0000000033edad20 transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e67 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115484:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44e67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115491:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xe0be4298 (ffff9c9d46811200) 00010000:00010000:3.0:1787096580.115493:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096580.115496:0:9995:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096580.115521:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44e59 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 12 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115535:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 11 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.115542:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9c9d46811500) 00010000:00010000:3.0:1787096580.115544:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096580.115547:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2800, rc 0) 00000100:00100000:3.0:1787096580.115606:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:40669:x1873906352893440:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1016us (1140us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787096580.115614:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 362 00000100:00100000:2.0:1787096580.117383:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096580.117616:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352893696 00000100:00100000:3.0:1787096580.117628:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352893696 00000100:00100000:3.0:1787096580.117697:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 363 00000100:00100000:3.0:1787096580.117706:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:40669:x1873906352893696:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096580.117731:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096580.117751:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b44e7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc7084 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.117852:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.117863:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 13 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.117869:0:6481:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.117894:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 13 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.117904:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 13 pid: 9995 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096580.117916:0:6481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fab3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6481:1873906360294016:192.168.203.27@tcp:104: 00000100:00100000:3.0:1787096580.117999:0:6481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e9f8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787096580.119329:0:6481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fab3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6481:1873906360294016:192.168.203.27@tcp:104: 00000100:00100000:1.0:1787096580.119331:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00010000:00010000:3.0:1787096580.119425:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096580.119502:0:6465:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352893824 00000100:00100000:2.0:1787096580.119511:0:6465:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352893824 00010000:00010000:2.0:1787096580.119551:0:6465:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 14 pid: 9995 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096580.119596:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:2.0:1787096580.119605:0:6465:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:2402:x1873906352893824:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096580.119618:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096580.119625:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 14 pid: 9995 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.119639:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 14 pid: 9995 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.119671:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44e6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc707d expref: 14 pid: 9995 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.119694:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9c9d46811500) 00010000:00010000:2.0:1787096580.119698:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.119708:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.119716:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096580.119746:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096580.119767:0:6481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.119774:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096580.119790:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00000100:00100000:2.0:1787096580.119815:0:6465:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:2402:x1873906352893824:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 209us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096580.119824:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 113 00010000:00010000:3.0:1787096580.119942:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120003:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120010:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120024:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3c00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096580.120028:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120035:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120048:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9c9d46811500) 00010000:00010000:3.0:1787096580.120051:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096580.120055:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120061:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44e83 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120107:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b44e7c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7084 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120117:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9c9d46811500) 00010000:00010000:3.0:1787096580.120119:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096580.120122:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b44e7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc7084 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096580.120147:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3400, rc 0) 00000100:00100000:3.0:1787096580.120198:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:40669:x1873906352893696:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2492us (2823us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096580.120206:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 363 00000100:00100000:1.0:1787096580.121591:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096580.121640:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352894080 00000100:00100000:2.0:1787096580.121648:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352894080 00000100:00100000:2.0:1787096580.121703:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1787096580.121714:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:40669:x1873906352894080:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1787096580.121890:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:40669:x1873906352894080:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 178us (305us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1787096580.121897:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000001:02000400:0.0:1787096580.682896:0:24512:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_28a: @@@@@@ FAIL: setstripe failed 00010000:00010000:3.0:1787096580.814639:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096580.814647:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096580.814689:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360294144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096580.814813:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096580.814863:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360294144 00000100:00100000:2.0:1787096580.814873:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360294144 00000100:00100000:2.0:1787096580.814940:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787096580.814950:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3626:x1873906360294144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096580.815002:0:7409:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446100992 avail 1299861504 00000100:00100000:2.0:1787096580.815048:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3626:x1873906360294144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096580.815055:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787096580.815097:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360294144:0@lo:41:osp-pre-0-1.0 Debug log: 1601 lines, 1601 kept, 0 dropped, 0 bad.