00000100:00100000:3.0F:1787096288.794448:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0F:1787096288.794507:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077081856
00000100:00100000:2.0:1787096288.794527:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077081856
00000100:00080000:3.0:1787096288.794577:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1787096288.794623:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 248
00000100:00100000:2.0:1787096288.794640:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a836fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+9:37185:x1873906077081856:12345-192.168.201.52@tcp:101:rm.0
00010000:00010000:2.0:1787096288.794668:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1787096288.794700:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50df59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b412d5 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.794793:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50df60 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.794813:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50df60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.794830:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50df60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1787096288.794951:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4096
00000004:00200000:2.0:1787096288.794958:0:6477:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2
00000004:00010000:2.0:1787096288.794984:0:6477:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50df60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.795018:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50df59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412d5 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.795046:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50df60 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412d5 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.795057:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7982e5cf00)
00010000:00010000:2.0:1787096288.795061:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00010000:2.0:1787096288.795067:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830eaa00, rc 0)
00000100:00100000:2.0:1787096288.795146:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a836fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37185:x1873906077081856:12345-192.168.201.52@tcp:101:rm.0 Request processed in 512us (706us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096288.795155:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 248
00000100:00100000:1.0F:1787096288.796731:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.796781:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077081984
00000100:00100000:2.0:1787096288.796787:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077081984
00000100:00080000:3.0:1787096288.796811:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1787096288.796829:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 249
00000100:00100000:2.0:1787096288.796837:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37185:x1873906077081984:12345-192.168.201.52@tcp:101:rm.0
00010000:00010000:2.0:1787096288.796851:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1787096288.796867:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50df67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b412dc expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.796899:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50df6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.796908:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50df6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.796917:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50df6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1787096288.796937:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 4096
00000004:00200000:2.0:1787096288.796942:0:21727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2
00010000:00010000:2.0:1787096288.796961:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50df67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412dc expref: 12 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.796975:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50df6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412dc expref: 11 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.796982:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c7a836ecf00)
00010000:00010000:2.0:1787096288.796992:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00010000:2.0:1787096288.796995:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830eb800, rc 0)
00000100:00100000:2.0:1787096288.797036:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077081984:12345-192.168.201.52@tcp:101:rm.0 Request processed in 198us (308us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096288.797043:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 249
00000100:00100000:2.0:1787096288.798035:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:1.0:1787096288.798071:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077082240
00000100:00100000:1.0:1787096288.798079:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077082240
00000100:00100000:1.0:1787096288.798128:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 250
00000100:00100000:1.0:1787096288.798138:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37185:x1873906077082240:12345-192.168.201.52@tcp:101:rm.0
00010000:00010000:1.0:1787096288.798158:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1787096288.798176:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50df75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b412e3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1787096288.798289:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4096
00010000:00010000:1.0:1787096288.798407:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50df75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412e3 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.798421:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7982e5c200)
00010000:00010000:1.0:1787096288.798423:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1787096288.798427:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50df75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412e3 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.798439:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6ab200, rc 0)
00000100:00100000:1.0:1787096288.798488:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077082240:12345-192.168.201.52@tcp:101:rm.0 Request processed in 353us (454us total) trans 4294967336 rc 301/301
00000100:00100000:1.0:1787096288.798495:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 250
00000100:00100000:3.0:1787096288.800024:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:1.0:1787096288.800062:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077082368
00000100:00100000:1.0:1787096288.800066:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077082368
00000100:00100000:1.0:1787096288.800096:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47
00000100:00100000:1.0:1787096288.800102:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac34d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077082368:12345-192.168.201.52@tcp:37:rm.0
00000100:00100000:1.0:1787096288.802395:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac34d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077082368:12345-192.168.201.52@tcp:37:rm.0 Request processed in 2287us (2367us total) trans 0 rc 0/0
00000100:00100000:1.0:1787096288.802419:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47
00000100:00100000:2.0:1787096288.804048:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:1.0:1787096288.804100:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077082496
00000100:00100000:1.0:1787096288.804106:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077082496
00000100:00100000:1.0:1787096288.804142:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48
00000100:00100000:1.0:1787096288.804150:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077082496:12345-192.168.201.52@tcp:37:rm.0
00000100:00100000:1.0:1787096288.805962:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077082496:12345-192.168.201.52@tcp:37:rm.0 Request processed in 1811us (1916us total) trans 0 rc 0/0
00000100:00100000:1.0:1787096288.805969:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48
00000100:00100000:1.0:1787096288.807234:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.807286:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077082752
00000100:00100000:2.0:1787096288.807296:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077082752
00000100:00100000:2.0:1787096288.807392:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49
00000100:00100000:2.0:1787096288.807405:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077082752:12345-192.168.201.52@tcp:35:rm.0
00000040:00080000:2.0:1787096288.807682:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].8, 344 off44528
00000040:00080000:2.0:1787096288.807748:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].8, 424 off45648
00000004:00080000:2.0:1787096288.807755:0:14257:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7a8862ad80 with version 16
00000004:00080000:3.0:1787096288.807808:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 16 rpc_version 16
00000020:00100000:3.0:1787096288.807842:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8
00000100:00100000:3.0:1787096288.807868:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid  req@ffff8c7a836f9880 x1873906084483200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787096288.807893:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a836f9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084483200:0@lo:1000:osp_up0-1.0
00000100:00100000:3.0:1787096288.807945:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1787096288.807987:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084483200
00000100:00100000:1.0:1787096288.807994:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084483200
00000100:00100000:3.0:1787096288.808000:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798323ef00 going to sleep for 11 seconds
00000100:00100000:1.0:1787096288.808044:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235
00000100:00100000:1.0:1787096288.808053:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a836f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7405:x1873906084483200:12345-0@lo:1000:osp_up0-1.0
00000100:00100000:1.0:1787096288.808211:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a836f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7405:x1873906084483200:12345-0@lo:1000:osp_up0-1.0 Request processed in 161us (265us total) trans 4294967390 rc 0/0
00000100:00100000:1.0:1787096288.808219:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235
00000100:00100000:3.0:1787096288.808284:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a836f9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084483200:0@lo:1000:osp_up0-1.0
00000100:00100000:2.0:1787096288.808430:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37185:x1873906077082752:12345-192.168.201.52@tcp:35:rm.0 Request processed in 1028us (1195us total) trans 4294967337 rc 0/0
00000100:00100000:2.0:1787096288.808440:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49
00000100:00100000:2.0:1787096288.809353:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:1.0:1787096288.809440:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077083008
00000100:00100000:1.0:1787096288.809446:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077083008
00000100:00100000:1.0:1787096288.809484:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 251
00000100:00100000:1.0:1787096288.809492:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37185:x1873906077083008:12345-192.168.201.52@tcp:101:rm.0
00010000:00010000:1.0:1787096288.809507:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1787096288.809522:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50df83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b412ea expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.809613:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50df8a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.809631:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50df8a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.809641:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50df8a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1787096288.809651:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4096
00010000:00010000:1.0:1787096288.809705:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50df83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412ea expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.809719:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50df8a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412ea expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.809726:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7982e5cf00)
00010000:00010000:1.0:1787096288.809728:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1787096288.809731:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6aaa00, rc 0)
00000100:00100000:1.0:1787096288.809763:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+14:37185:x1873906077083008:12345-192.168.201.52@tcp:101:rm.0 Request processed in 273us (413us total) trans 4294967338 rc 0/0
00000100:00100000:1.0:1787096288.809768:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 251
00000100:00100000:3.0:1787096288.810864:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.810915:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077083136
00000100:00100000:2.0:1787096288.810923:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077083136
00000100:00100000:2.0:1787096288.810973:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 252
00000100:00100000:2.0:1787096288.810986:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a836fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077083136:12345-192.168.201.52@tcp:41:rm.0
00000004:00000024:2.0:1787096288.811033:0:10275:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848
00000100:00100000:2.0:1787096288.811093:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a836fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077083136:12345-192.168.201.52@tcp:41:rm.0 Request processed in 109us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096288.811106:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 252
00000100:00100000:3.0:1787096288.811878:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.811931:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077083264
00000100:00100000:2.0:1787096288.811946:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077083264
00000100:00100000:2.0:1787096288.811994:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 253
00000100:00100000:2.0:1787096288.812006:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a836f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37185:x1873906077083264:12345-192.168.201.52@tcp:101:rm.0
00010000:00010000:2.0:1787096288.812017:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1787096288.812038:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50df98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b412f1 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812088:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812099:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812108:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812117:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812124:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812129:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812194:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50dfad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812200:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812205:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1787096288.812235:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0
00000004:00200000:2.0:1787096288.812239:0:8384:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2
00000004:00010000:2.0:1787096288.812252:0:8384:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812264:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50dfad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812275:0:8384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812285:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812292:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812300:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812308:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ebe00 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:2.0:1787096288.812313:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812321:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812345:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c7a836ecf00)
00010000:00010000:2.0:1787096288.812348:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096288.812352:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812401:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50df9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812414:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812419:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812425:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812430:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ea400 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:2.0:1787096288.812433:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812438:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812449:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff8c7a836ec200)
00010000:00010000:2.0:1787096288.812452:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096288.812454:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812459:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dfa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812480:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea600/0x9eebb2eb7f50df98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412f1 expref: 13 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812490:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50dfad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412f1 expref: 12 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.812501:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8c7a836ecd00)
00010000:00010000:2.0:1787096288.812505:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1787096288.812507:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830eb600, rc 0)
00000100:00100000:2.0:1787096288.812538:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a836f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37185:x1873906077083264:12345-192.168.201.52@tcp:101:rm.0 Request processed in 536us (665us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096288.812547:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 253
00000100:00100000:2.0:1787096288.813533:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:3.0:1787096288.813579:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077083520
00000100:00100000:3.0:1787096288.813585:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077083520
00000100:00100000:3.0:1787096288.813627:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 254
00000100:00100000:3.0:1787096288.813641:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37185:x1873906077083520:12345-192.168.201.52@tcp:36:rm.0
00010000:00010000:3.0:1787096288.813670:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1787096288.813684:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb600/0x9eebb2eb7f50dfad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412f1 expref: 12 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813696:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8c7a836ecd00)
00010000:00010000:3.0:1787096288.813705:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb800/0x9eebb2eb7f50df6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412dc expref: 11 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813713:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c7a836ecf00)
00010000:00010000:3.0:1787096288.813719:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1787096288.813743:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813751:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813757:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813767:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dfbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813772:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dfbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813778:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dfbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813822:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813827:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813832:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813975:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813983:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.813989:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814001:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814006:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814010:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814031:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1787096288.814043:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814049:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814049:0:6466:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1787096288.814060:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814061:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814096:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebac00 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:1.0:1787096288.814098:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82eba200 already unused, calling callback (ffffffffc0bef6f0)
00010000:00010000:3.0:1787096288.814101:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814104:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814117:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814123:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814128:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8c7aadca5100)
00010000:00010000:3.0:1787096288.814133:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1787096288.814142:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814154:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8c7aadca5100)
00010000:00010000:1.0:1787096288.814166:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1787096288.814167:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50dfc2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814170:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814183:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba200/0x9eebb2eb7f50dfc9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814188:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814197:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814202:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814203:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1787096288.814210:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787096288.814218:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.814219:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787096288.814228:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebaa00 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:3.0:1787096288.814231:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814235:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814242:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c7aadca5b00)
00010000:00010000:3.0:1787096288.814244:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1787096288.814246:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814250:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50dfb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1787096288.814263:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009bece9b5 reply state 00000000e0deba7d transno 4294967391 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dfbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814278:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb600/0x9eebb2eb7f50dfbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.814284:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff8c7a836ec200)
00010000:00010000:3.0:1787096288.814285:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00000100:00100000:3.0:1787096288.814288:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1787096288.814342:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37185:x1873906077083520:12345-192.168.201.52@tcp:36:rm.0 Request processed in 707us (811us total) trans 4294967391 rc 0/0
00000100:00100000:3.0:1787096288.814348:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 254
00000100:00100000:3.0:1787096288.815504:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.815538:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077083648
00000100:00100000:3.0:1787096288.815545:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.815546:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077083648
00000100:00100000:1.0:1787096288.815588:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077083904
00000100:00100000:1.0:1787096288.815594:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077083904
00000100:00100000:2.0:1787096288.815605:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24
00000100:00100000:2.0:1787096288.815621:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+12:2407:x1873906077083648:12345-192.168.201.52@tcp:103:rm.0
00010000:00010000:2.0:1787096288.815632:0:8375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1787096288.815644:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50
00010000:00010000:2.0:1787096288.815652:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50dee2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412a4 expref: 12 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1787096288.815666:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+14:37185:x1873906077083904:12345-192.168.201.52@tcp:35:rm.0
00010000:00010000:2.0:1787096288.815675:0:8375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7a836eca00)
00010000:00010000:2.0:1787096288.815683:0:8375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1787096288.815719:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+11:2407:x1873906077083648:12345-192.168.201.52@tcp:103:rm.0 Request processed in 105us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096288.815733:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24
00000100:00100000:1.0:1787096288.815817:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+15:37185:x1873906077083904:12345-192.168.201.52@tcp:35:rm.0 Request processed in 161us (269us total) trans 4294967339 rc 0/0
00000100:00100000:1.0:1787096288.815823:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50
00000100:00100000:1.0:1787096288.816536:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.816574:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077084160
00000100:00100000:2.0:1787096288.816579:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077084160
00000100:00100000:2.0:1787096288.816614:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 255
00000100:00100000:2.0:1787096288.816621:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+15:37185:x1873906077084160:12345-192.168.201.52@tcp:36:rm.0
00010000:00010000:2.0:1787096288.816648:0:21727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:2.0:1787096288.816668:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50df8a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412ea expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.816684:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50df60 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412d5 expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.816699:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50def0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412ab expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.816706:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7982e5cf00)
00010000:00010000:2.0:1787096288.816709:0:21727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1787096288.816744:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.816750:0:21727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.816757:0:21727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.816772:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483328:0@lo:101:mdt00_005.0
00000100:00100000:2.0:1787096288.816805:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.816849:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a600 going to sleep for 11 seconds
00000100:00100000:3.0:1787096288.816850:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084483328
00000100:00100000:3.0:1787096288.816856:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084483328
00000100:00100000:3.0:1787096288.816897:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236
00000100:00100000:3.0:1787096288.816907:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:21727:x1873906084483328:12345-0@lo:101:mdt00_005.0
00010000:00010000:3.0:1787096288.816922:0:7407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1787096288.816936:0:7407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50dfd0 expref: -99 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.816959:0:7407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50dec6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4129d expref: 10 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.816971:0:7407:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 8 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.816998:0:7407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50dec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4129d expref: 10 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.817022:0:7407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50dec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4129d expref: 10 pid: 10275 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1787096288.817031:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839bc700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7407:1873906084483456:192.168.201.52@tcp:104:
00000100:00100000:3.0:1787096288.817080:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798323eb40 going to sleep for 11 seconds
00000100:00100000:2.0:1787096288.817756:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839bc700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7407:1873906084483456:192.168.201.52@tcp:104:
00010000:00010000:2.0:1787096288.817778:0:7407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 8 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.817786:0:7407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:2.0:1787096288.817788:0:7407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096288.817799:0:7407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 8 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.817806:0:7407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebbc00, rc 0)
00000100:00100000:2.0:1787096288.817845:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:21727:x1873906084483328:12345-0@lo:101:mdt00_005.0 Request processed in 941us (1039us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096288.817852:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236
00000100:00100000:3.0:1787096288.817863:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483328:0@lo:101:mdt00_005.0
00010000:00010000:3.0:1787096288.817879:0:21727:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.817886:0:21727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1787096288.817946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096288.817991:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077084288
00000100:00100000:2.0:1787096288.817997:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077084288
00010000:00010000:2.0:1787096288.818021:0:6464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50dec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4129d expref: 11 pid: 10275 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.818066:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81
00000100:00100000:2.0:1787096288.818075:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+11:2407:x1873906077084288:12345-192.168.201.52@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1787096288.818083:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1787096288.818087:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50dec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4129d expref: 11 pid: 10275 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.818097:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50dec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4129d expref: 11 pid: 10275 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.818109:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50dec6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4129d expref: 11 pid: 10275 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.818118:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:2.0:1787096288.818122:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 7 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.818143:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 7 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.818149:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 7 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.818169:0:6464:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 7 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.818178:0:6464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6464:1873906084483584:0@lo:105:
00000100:00100000:2.0:1787096288.818207:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1787096288.818254:0:8373:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084483584
00000100:00100000:1.0:1787096288.818260:0:8373:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084483584
00000100:00100000:2.0:1787096288.818261:0:6464:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a480 going to sleep for 11 seconds
00000100:00100000:1.0:1787096288.818300:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54
00000100:00100000:1.0:1787096288.818310:0:8373:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6464:x1873906084483584:12345-0@lo:105:
00010000:00010000:1.0:1787096288.818320:0:8373:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast  ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.818340:0:8373:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.818388:0:8373:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.818396:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.818403:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.818411:0:8373:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.818430:0:8373:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c79830ebc00)
00010000:00010000:3.0:1787096288.818453:0:21727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.818463:0:21727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1787096288.818481:0:8373:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6464:x1873906084483584:12345-0@lo:105: Request processed in 170us (269us total) trans 0 rc 0/0
00000004:00080000:3.0:1787096288.818490:0:21727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0]
00000100:00100000:1.0:1787096288.818496:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54
00000100:00100000:2.0:1787096288.818525:0:6464:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6464:1873906084483584:0@lo:105:
00010000:00010000:3.0:1787096288.818531:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.818538:0:21727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.818546:0:21727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.818553:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1787096288.818578:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483712:0@lo:101:mdt00_005.0
00000100:00100000:2.0:1787096288.818595:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+10:2407:x1873906077084288:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 518us (647us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096288.818609:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81
00000100:00100000:3.0:1787096288.818640:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1787096288.818685:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798323eb40 going to sleep for 11 seconds
00000100:00100000:3.0:1787096288.818725:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084483712
00000100:00100000:3.0:1787096288.818731:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084483712
00000100:00100000:3.0:1787096288.818854:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237
00000100:00100000:3.0:1787096288.818872:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:21727:x1873906084483712:12345-0@lo:101:mdt00_005.0
00010000:00010000:3.0:1787096288.818882:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1787096288.818900:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dfe5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50dfde expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.818917:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dfe5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfde expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.818926:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dfe5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfde expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.818932:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffff8c7aadca5300)
00010000:00010000:3.0:1787096288.818934:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1787096288.818937:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebb400, rc 0)
00000100:00100000:3.0:1787096288.818988:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:21727:x1873906084483712:12345-0@lo:101:mdt00_005.0 Request processed in 127us (358us total) trans 0 rc 0/0
00000100:00100000:3.0:1787096288.818997:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237
00000100:00100000:2.0:1787096288.819035:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483712:0@lo:101:mdt00_005.0
00010000:00010000:2.0:1787096288.819057:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.819067:0:21727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1787096288.819080:0:21727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0]
00000100:00100000:2.0:1787096288.819122:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483840:0@lo:1000:mdt00_005.0
00000100:00100000:2.0:1787096288.819161:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.819181:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a900 going to sleep for 11 seconds
00000100:00100000:3.0:1787096288.819199:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084483840
00000100:00100000:3.0:1787096288.819205:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084483840
00000100:00100000:3.0:1787096288.819244:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238
00000100:00100000:3.0:1787096288.819250:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:21727:x1873906084483840:12345-0@lo:1000:mdt00_005.0
00000100:00100000:3.0:1787096288.819342:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:21727:x1873906084483840:12345-0@lo:1000:mdt00_005.0 Request processed in 89us (178us total) trans 0 rc 0/0
00000100:00100000:3.0:1787096288.819350:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238
00000100:00100000:2.0:1787096288.819409:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483840:0@lo:1000:mdt00_005.0
00000100:00100000:2.0:1787096288.819479:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483968:0@lo:1000:mdt00_005.0
00000100:00100000:2.0:1787096288.819525:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.819544:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a900 going to sleep for 11 seconds
00000100:00100000:3.0:1787096288.819547:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084483968
00000100:00100000:3.0:1787096288.819553:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084483968
00000100:00100000:3.0:1787096288.819605:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239
00000100:00100000:3.0:1787096288.819616:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:21727:x1873906084483968:12345-0@lo:1000:mdt00_005.0
00000100:00100000:3.0:1787096288.819692:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:21727:x1873906084483968:12345-0@lo:1000:mdt00_005.0 Request processed in 79us (173us total) trans 0 rc 1/1
00000100:00100000:2.0:1787096288.819702:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084483968:0@lo:1000:mdt00_005.0
00000100:00100000:3.0:1787096288.819704:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239
00010000:00010000:2.0:1787096288.819747:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.819755:0:21727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.819762:0:21727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.819774:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084484096:0@lo:101:mdt00_005.0
00000100:00100000:2.0:1787096288.819800:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.819832:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a480 going to sleep for 11 seconds
00000100:00100000:0.0F:1787096288.819855:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084484096
00000100:00100000:0.0:1787096288.819866:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084484096
00000100:00100000:0.0:1787096288.819903:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240
00000100:00100000:0.0:1787096288.819916:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:21727:x1873906084484096:12345-0@lo:101:mdt00_005.0
00010000:00010000:0.0:1787096288.819926:0:7407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1787096288.819939:0:7407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50dff3 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50dfec expref: -99 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.819954:0:7407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50dff3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfec expref: 10 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.819963:0:7407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50dff3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfec expref: 10 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.819968:0:7407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7a92ea9200)
00010000:00010000:0.0:1787096288.819970:0:7407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1787096288.819972:0:7407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762000, rc 0)
00000100:00100000:0.0:1787096288.820011:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:21727:x1873906084484096:12345-0@lo:101:mdt00_005.0 Request processed in 100us (209us total) trans 0 rc 0/0
00000100:00100000:0.0:1787096288.820016:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240
00000100:00100000:2.0:1787096288.820048:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084484096:0@lo:101:mdt00_005.0
00010000:00010000:2.0:1787096288.820058:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820066:0:21727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820083:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820096:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820104:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820120:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820128:0:21727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab800/0x9eebb2eb7f50defe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412b2 expref: 12 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820133:0:21727:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820151:0:21727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab800/0x9eebb2eb7f50defe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412b2 expref: 12 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.820160:0:21727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab800/0x9eebb2eb7f50defe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412b2 expref: 12 pid: 21727 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.820169:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21727:1873906084484224:192.168.201.52@tcp:104:
00000100:00100000:2.0:1787096288.820210:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a480 going to sleep for 11 seconds
00000100:00100000:2.0:1787096288.820844:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21727:1873906084484224:192.168.201.52@tcp:104:
00010000:00010000:2.0:1787096288.820862:0:21727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.821004:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:1.0:1787096288.821053:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077084416
00000100:00100000:1.0:1787096288.821059:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077084416
00010000:00010000:1.0:1787096288.821079:0:6463:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab800/0x9eebb2eb7f50defe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412b2 expref: 13 pid: 21727 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1787096288.821105:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82
00000100:00100000:1.0:1787096288.821112:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+13:2406:x1873906077084416:12345-192.168.201.52@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1787096288.821121:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1787096288.821125:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab800/0x9eebb2eb7f50defe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412b2 expref: 13 pid: 21727 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.821144:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab800/0x9eebb2eb7f50defe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412b2 expref: 13 pid: 21727 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.821157:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab800/0x9eebb2eb7f50defe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412b2 expref: 13 pid: 21727 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.821166:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x7:0x0].0x0 (ffff8c7982e5c100)
00010000:00010000:1.0:1787096288.821169:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.821175:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.821179:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096288.821194:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1787096288.821216:0:21727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1787096288.821228:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+12:2406:x1873906077084416:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 114us (224us total) trans 0 rc 0/0
00010000:00010000:2.0:1787096288.821238:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1787096288.821243:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82
00010000:00010000:2.0:1787096288.821282:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.821292:0:21727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.821302:0:21727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.821321:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084484352:0@lo:101:mdt00_005.0
00000100:00100000:2.0:1787096288.821456:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.821478:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a480 going to sleep for 11 seconds
00000100:00100000:3.0:1787096288.821484:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084484352
00000100:00100000:3.0:1787096288.821489:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084484352
00000100:00100000:3.0:1787096288.821525:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241
00000100:00100000:3.0:1787096288.821533:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aad0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:21727:x1873906084484352:12345-0@lo:101:mdt00_005.0
00010000:00010000:3.0:1787096288.821541:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1787096288.821553:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e00f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50e008 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.821576:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e00f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e008 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.821589:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e00f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e008 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.821597:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c7aadca5b00)
00010000:00010000:3.0:1787096288.821600:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1787096288.821605:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebac00, rc 0)
00000100:00100000:3.0:1787096288.821643:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aad0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:21727:x1873906084484352:12345-0@lo:101:mdt00_005.0 Request processed in 112us (188us total) trans 0 rc 0/0
00000100:00100000:3.0:1787096288.821650:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241
00000100:00100000:2.0:1787096288.821674:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084484352:0@lo:101:mdt00_005.0
00010000:00010000:2.0:1787096288.821684:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.821691:0:21727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.822446:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084484480:0@lo:403:mdt00_005.0
00000100:00100000:2.0:1787096288.822480:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.822498:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a8862a480 going to sleep for 11 seconds
00000100:00100000:3.0:1787096288.822502:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084484480
00000100:00100000:3.0:1787096288.822506:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084484480
00000100:00100000:3.0:1787096288.822541:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242
00000100:00100000:3.0:1787096288.822547:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:21727:x1873906084484480:12345-0@lo:403:mdt00_005.0
00000100:00100000:3.0:1787096288.824786:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:21727:x1873906084484480:12345-0@lo:403:mdt00_005.0 Request processed in 2238us (2303us total) trans 0 rc 0/0
00000100:00100000:3.0:1787096288.824795:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242
00000100:00100000:2.0:1787096288.824816:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21727:1873906084484480:0@lo:403:mdt00_005.0
00000040:00080000:2.0:1787096288.825829:0:21727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].9, 936 off45464
00000040:00080000:2.0:1787096288.826041:0:21727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].9, 1016 off46664
00000004:00080000:2.0:1787096288.826049:0:21727:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7a8862a480 with version 17
00000004:00080000:3.0:1787096288.826096:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 17 rpc_version 17
00000020:00100000:3.0:1787096288.826124:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8
00000100:00100000:3.0:1787096288.826131:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid  req@ffff8c79839bc380 x1873906084484736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2336/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787096288.826147:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839bc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084484736:0@lo:1000:osp_up0-1.0
00000100:00100000:3.0:1787096288.826174:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1787096288.826196:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798323e780 going to sleep for 11 seconds
00000100:00100000:2.0:1787096288.826214:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084484736
00000100:00100000:2.0:1787096288.826219:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084484736
00000100:00100000:2.0:1787096288.826261:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243
00000100:00100000:2.0:1787096288.826270:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7405:x1873906084484736:12345-0@lo:1000:osp_up0-1.0
00000100:00100000:2.0:1787096288.826699:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:7405:x1873906084484736:12345-0@lo:1000:osp_up0-1.0 Request processed in 429us (523us total) trans 4294967392 rc 0/0
00000100:00100000:2.0:1787096288.826711:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243
00000100:00100000:0.0:1787096288.826771:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839bc380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084484736:0@lo:1000:osp_up0-1.0
00000004:00200000:2.0:1787096288.826791:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4096
00010000:00010000:2.0:1787096288.826807:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826814:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826826:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826833:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ebe00 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:2.0:1787096288.826838:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826846:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826858:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x7:0x0].0x0 (ffff8c7982e5c100)
00010000:00010000:2.0:1787096288.826861:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1787096288.826866:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826883:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e001 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826896:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826902:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826906:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826925:0:21727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000004:00080000:2.0:1787096288.826930:0:21727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x7:0x0]
00010000:00010000:2.0:1787096288.826934:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826939:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826944:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.826946:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1787096288.826949:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ea400 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:0.0:1787096288.826953:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.826954:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.826996:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb200 already unused, calling callback (ffffffffc1765ee0)
00010000:00010000:2.0:1787096288.826997:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827003:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1787096288.827046:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.827050:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7982e5cf00)
00010000:00010000:2.0:1787096288.827055:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096288.827060:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.827068:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50dffa lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827076:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.827081:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827085:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:2.0:1787096288.827102:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.827112:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827118:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827124:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eb200/0x9eebb2eb7f50e008 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50e00f expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1787096288.827131:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084484864:0@lo:103:ldlm_bl.0
00010000:00010000:2.0:1787096288.827138:0:21727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1787096288.827144:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1787096288.827148:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1787096288.827150:0:21727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0]
00010000:00010000:0.0:1787096288.827161:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eba00 already unused, calling callback (ffffffffc1765ee0)
00010000:00010000:2.0:1787096288.827165:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827167:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1787096288.827191:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00010000:0.0:1787096288.827205:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.827210:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.827220:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827228:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827233:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed
00000100:00100000:3.0:1787096288.827246:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084484864
00010000:00010000:2.0:1787096288.827246:0:21727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1787096288.827251:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084484864
00010000:00010000:0.0:1787096288.827262:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 1/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1787096288.827263:0:21727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0]
00010000:00010000:2.0:1787096288.827281:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827281:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830eba00/0x9eebb2eb7f50dfec lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dff3 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1787096288.827305:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25
00010000:00010000:2.0:1787096288.827333:0:21727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827343:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:3.0:1787096288.827350:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3627:x1873906084484864:12345-0@lo:103:ldlm_bl.0
00010000:00010000:0.0:1787096288.827351:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.827402:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1787096288.827406:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ebc00 already unused, calling callback (ffffffffc1765ee0)
00010000:00010000:0.0:1787096288.827412:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1787096288.827421:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.827424:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e00f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50e008 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096288.827452:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37185:x1873906077084160:12345-192.168.201.52@tcp:36:rm.0 Request processed in 10823us (10908us total) trans 4294967340 rc 0/0
00000100:00100000:2.0:1787096288.827466:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 255
00010000:00010000:0.0:1787096288.827474:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827481:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:3.0:1787096288.827486:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c7aadca5b00)
00010000:00010000:0.0:1787096288.827489:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827496:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c79830ebc00/0x9eebb2eb7f50dfd0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dfd7 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096288.827498:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1787096288.827511:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787096288.827513:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787096288.827516:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787096288.827545:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787096288.827557:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3627:x1873906084484864:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (377us total) trans 0 rc 0/0
00000100:00100000:0.0:1787096288.827563:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084484992:0@lo:103:ldlm_bl.0
00000100:00100000:3.0:1787096288.827572:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25
00000100:00100000:0.0:1787096288.827611:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.827652:0:7401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084484992
00000100:00100000:0.0:1787096288.827654:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1787096288.827657:0:7401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084484992
00000100:00100000:0.0:1787096288.827664:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084485120:0@lo:103:ldlm_bl.0
00010000:00010000:3.0:1787096288.827667:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787096288.827693:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084484864:0@lo:103:ldlm_bl.0
00000100:00100000:2.0:1787096288.827720:0:7401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26
00000100:00100000:0.0:1787096288.827726:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096288.827734:0:7401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3628:x1873906084484992:12345-0@lo:103:ldlm_bl.0
00010000:00010000:2.0:1787096288.827742:0:7401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1787096288.827743:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084485120
00000100:00100000:3.0:1787096288.827750:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084485120
00010000:00010000:2.0:1787096288.827758:0:7401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50dff3 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfec expref: 12 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096288.827776:0:7401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7a92ea9200)
00010000:00010000:2.0:1787096288.827784:0:7401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1787096288.827813:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27
00000100:00100000:0.0:1787096288.827826:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3628:x1873906084485120:12345-0@lo:103:ldlm_bl.0
00010000:00010000:0.0:1787096288.827837:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1787096288.827844:0:7401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3628:x1873906084484992:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (228us total) trans 0 rc 0/0
00010000:00010000:0.0:1787096288.827855:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebbc00/0x9eebb2eb7f50dfd7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfd0 expref: 11 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096288.827868:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:0.0:1787096288.827871:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1787096288.827886:0:7401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26
00000100:00100000:0.0:1787096288.827912:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3628:x1873906084485120:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (196us total) trans 0 rc 0/0
00000100:00100000:0.0:1787096288.827917:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27
00000100:00100000:0.0:1787096288.827948:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084485120:0@lo:103:ldlm_bl.0
00000100:00100000:0.0:1787096288.827956:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084484992:0@lo:103:ldlm_bl.0
00010000:00010000:1.0:1787096288.944694:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:02000400:1.0:1787096289.380702:0:23236:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 26a: multi-stripe EC data integrity with 20M file ========================================================== 19:38:08 (1787096288)
00000100:00100000:2.0:1787096289.433545:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:1.0:1787096289.433620:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077084544
00000100:00100000:1.0:1787096289.433635:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077084544
00000100:00100000:1.0:1787096289.433786:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 256
00000100:00100000:1.0:1787096289.433814:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37354:x1873906077084544:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:1.0:1787096289.433841:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1787096289.433873:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b412f8 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.433943:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e01d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.433959:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e01d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.433972:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e01d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1787096289.434016:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096
00000004:00200000:1.0:1787096289.434019:0:6478:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2
00000004:00010000:1.0:1787096289.434040:0:6478:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e01d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.434064:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412f8 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.434089:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e01d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412f8 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.434098:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:1.0:1787096289.434101:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1787096289.434104:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6aa000, rc 0)
00000100:00100000:1.0:1787096289.434176:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37354:x1873906077084544:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 379us (640us total) trans 0 rc 0/0
00000100:00100000:1.0:1787096289.434184:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 256
00000100:00100000:2.0:1787096289.435267:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:1.0:1787096289.435421:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077084672
00000100:00100000:1.0:1787096289.435435:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077084672
00000100:00100000:1.0:1787096289.435480:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 257
00000100:00100000:1.0:1787096289.435490:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a9054f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37354:x1873906077084672:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:1.0:1787096289.435499:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1787096289.435509:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b412ff expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435544:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435553:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435561:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435593:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435600:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435607:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435643:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435651:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435657:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435675:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435686:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aa600 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:1.0:1787096289.435709:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435721:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435738:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:1.0:1787096289.435743:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1787096289.435748:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435759:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa600/0x9eebb2eb7f50e02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435777:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435784:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435790:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435794:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aa800 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:1.0:1787096289.435797:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435816:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435825:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff8c7982e5c200)
00010000:00010000:1.0:1787096289.435827:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1787096289.435830:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435836:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e032 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435861:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e024 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412ff expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435871:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:1.0:1787096289.435873:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1787096289.435877:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412ff expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1787096289.435884:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6aba00, rc 0)
00000100:00100000:1.0:1787096289.435924:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a9054f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37354:x1873906077084672:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 436us (661us total) trans 0 rc 301/301
00000100:00100000:1.0:1787096289.435931:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 257
00000100:00100000:3.0:1787096289.437723:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096289.437793:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077084928
00000100:00100000:2.0:1787096289.437804:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077084928
00000100:00100000:2.0:1787096289.437879:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 258
00000100:00100000:2.0:1787096289.437913:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+11:37354:x1873906077084928:12345-192.168.201.52@tcp:36:lfs.0
00010000:00010000:2.0:1787096289.437960:0:10275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1787096289.437981:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e01d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b412f8 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.438003:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:2.0:1787096289.438010:0:10275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1787096289.438051:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.438067:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.438081:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.438101:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50e040 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.438113:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50e040 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.438124:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50e040 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1787096289.439511:0:10275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].5, 2152 off41096
00000040:00080000:2.0:1787096289.439652:0:10275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].5, 2352 off41856
00000004:00080000:2.0:1787096289.439663:0:10275:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8c7aad283a80 with version 11
00000004:00080000:3.0:1787096289.439707:0:7977:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7a87ed4300 version 11 rpc_version 11
00000020:00100000:3.0:1787096289.439759:0:7977:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8
00000100:00100000:3.0:1787096289.439770:0:7977:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid  req@ffff8c79839bd880 x1873906084485376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787096289.439795:0:7977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839bd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084485376:0@lo:1000:osp_up1-0.0
00000100:00100000:3.0:1787096289.439897:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096289.439962:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084485376
00000100:00100000:2.0:1787096289.439969:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084485376
00000100:00100000:3.0:1787096289.439972:0:7977:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983307600 going to sleep for 11 seconds
00000100:00100000:2.0:1787096289.440053:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244
00000100:00100000:2.0:1787096289.440084:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7977:x1873906084485376:12345-0@lo:1000:osp_up1-0.0
00000100:00100000:2.0:1787096289.440760:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7977:x1873906084485376:12345-0@lo:1000:osp_up1-0.0 Request processed in 682us (858us total) trans 4294967341 rc 0/0
00000100:00100000:2.0:1787096289.440772:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244
00000100:00100000:3.0:1787096289.440830:0:7977:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839bd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084485376:0@lo:1000:osp_up1-0.0
00010000:00010000:2.0:1787096289.440920:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50e047 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.440931:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.440939:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.440955:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50e04e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.440962:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50e04e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.440969:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50e04e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441004:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441009:0:10275:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441017:0:10275:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.441038:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10275:1873906084485504:0@lo:101:mdt00_004.0
00000100:00100000:2.0:1787096289.441080:0:10275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096289.441125:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aad0ee840 going to sleep for 11 seconds
00000100:00100000:3.0:1787096289.441133:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084485504
00000100:00100000:3.0:1787096289.441155:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084485504
00000100:00100000:3.0:1787096289.441212:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245
00000100:00100000:3.0:1787096289.441219:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:10275:x1873906084485504:12345-0@lo:101:mdt00_004.0
00010000:00010000:3.0:1787096289.441240:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1787096289.441260:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e05c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50e055 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.441296:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e05c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e055 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.441309:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e05c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e055 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.441329:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5c00)
00010000:00010000:3.0:1787096289.441332:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1787096289.441335:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebac00, rc 0)
00000100:00100000:3.0:1787096289.441415:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:10275:x1873906084485504:12345-0@lo:101:mdt00_004.0 Request processed in 196us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1787096289.441425:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245
00000100:00100000:2.0:1787096289.441464:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10275:1873906084485504:0@lo:101:mdt00_004.0
00010000:00010000:2.0:1787096289.441499:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441513:0:10275:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1787096289.441532:0:10275:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed3ce2ec reply state 00000000e0552c11 transno 4294967393 ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50e04e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441543:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50e04e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441550:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8c7a836ec100)
00010000:00010000:2.0:1787096289.441554:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00000100:00100000:2.0:1787096289.441556:0:10275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1787096289.441561:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441569:0:10275:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1787096289.441578:0:10275:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x6:0x0]
00000004:00010000:2.0:1787096289.441583:0:10275:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed3ce2ec reply state 00000000e0552c11 transno 4294967393 ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50e047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441591:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50e047 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441607:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8c7a836ec800)
00010000:00010000:2.0:1787096289.441609:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00000100:00100000:2.0:1787096289.441611:0:10275:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00000004:00200000:2.0:1787096289.441615:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096
00010000:00010000:2.0:1787096289.441620:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441627:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441633:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441638:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb400 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:2.0:1787096289.441641:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441647:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441657:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:2.0:1787096289.441660:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096289.441665:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441674:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e039 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1787096289.441690:0:10275:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed3ce2ec reply state 00000000e0552c11 transno 4294967393 ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50e040 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441722:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830eaa00/0x9eebb2eb7f50e040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.441733:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff8c7a836ec700)
00010000:00010000:2.0:1787096289.441737:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00000100:00100000:2.0:1787096289.441740:0:10275:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:2.0:1787096289.441807:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37354:x1873906077084928:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 3903us (4087us total) trans 4294967393 rc 0/0
00000100:00100000:2.0:1787096289.441832:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 258
00000100:00100000:3.0:1787096289.451212:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:0.0:1787096289.451481:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077085056
00000100:00100000:0.0:1787096289.451490:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077085056
00000100:00100000:0.0:1787096289.451536:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 259
00000100:00100000:0.0:1787096289.451545:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37357:x1873906077085056:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:0.0:1787096289.451563:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1787096289.451579:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50e063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41306 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.451642:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50e06a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.451653:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50e06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.451663:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50e06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1787096289.451695:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096
00000004:00200000:0.0:1787096289.451697:0:8384:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2
00000004:00010000:0.0:1787096289.451713:0:8384:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50e06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.451730:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50e063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41306 expref: 14 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.451743:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50e06a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41306 expref: 13 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.451750:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:0.0:1787096289.451752:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1787096289.451754:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763a00, rc 0)
00000100:00100000:0.0:1787096289.451816:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+13:37357:x1873906077085056:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 273us (611us total) trans 0 rc 0/0
00000100:00100000:0.0:1787096289.451821:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 259
00000100:00100000:2.0:1787096289.453031:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:0.0:1787096289.453099:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077085184
00000100:00100000:0.0:1787096289.453105:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077085184
00000100:00100000:0.0:1787096289.453167:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 260
00000100:00100000:0.0:1787096289.453177:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+13:37357:x1873906077085184:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:0.0:1787096289.453186:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1787096289.453194:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4130d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453230:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453238:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453245:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453255:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453261:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453269:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453389:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50e086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453396:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50e086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453403:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50e086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1787096289.453480:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096
00000004:00200000:0.0:1787096289.453484:0:6477:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2
00000004:00010000:0.0:1787096289.453496:0:6477:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50e086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453506:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453513:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453519:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453524:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453531:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762400 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:0.0:1787096289.453534:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453540:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453552:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300)
00010000:00010000:0.0:1787096289.453554:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1787096289.453557:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453563:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e078 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453587:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453592:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453598:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453604:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763c00 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:0.0:1787096289.453607:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453611:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453623:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff8c7a836ec700)
00010000:00010000:0.0:1787096289.453625:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1787096289.453628:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453632:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e07f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453656:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4130d expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453693:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50e086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4130d expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.453731:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8c7a836ec800)
00010000:00010000:0.0:1787096289.453737:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11
00010000:00010000:0.0:1787096289.453740:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763600, rc 0)
00000100:00100000:0.0:1787096289.453787:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+14:37357:x1873906077085184:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 612us (763us total) trans 0 rc 0/0
00000100:00100000:0.0:1787096289.453803:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 260
00000100:00100000:2.0:1787096289.454754:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:0.0:1787096289.454840:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077085312
00000100:00100000:0.0:1787096289.454846:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077085312
00000100:00100000:0.0:1787096289.454890:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 261
00000100:00100000:0.0:1787096289.454922:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+14:37357:x1873906077085312:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:0.0:1787096289.454934:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1787096289.454950:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762a00/0x9eebb2eb7f50e08d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41314 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.454981:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.454989:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.454996:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1787096289.455016:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x6:0x0]: returning size 4096
00000004:00200000:0.0:1787096289.455019:0:21727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2
00010000:00010000:0.0:1787096289.455038:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762a00/0x9eebb2eb7f50e08d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 16 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.455079:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 15 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.455085:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8c7a836ec100)
00010000:00010000:0.0:1787096289.455087:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00010000:0.0:1787096289.455089:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763e00, rc 0)
00000100:00100000:0.0:1787096289.455119:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+15:37357:x1873906077085312:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 222us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1787096289.455124:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 261
00000100:00100000:3.0:1787096289.455880:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:0.0:1787096289.455927:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077085440
00000100:00100000:0.0:1787096289.455934:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077085440
00000100:00100000:0.0:1787096289.455979:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 262
00000100:00100000:0.0:1787096289.455991:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+12:37357:x1873906077085440:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:0.0:1787096289.456006:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1787096289.456017:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50e09b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4131b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.456059:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.456069:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e05c lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e055 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.456076:0:6478:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.456102:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e05c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9eebb2eb7f50e055 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1787096289.456122:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6478:1873906084485632:0@lo:104:
00000100:00100000:0.0:1787096289.456160:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1787096289.456208:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7000 going to sleep for 11 seconds
00000100:00100000:2.0:1787096289.456210:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0
00000100:00100000:2.0:1787096289.456228:0:6460:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084485632
00000100:00100000:2.0:1787096289.456234:0:6460:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084485632
00000100:00100000:2.0:1787096289.456285:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55
00000100:00100000:2.0:1787096289.456306:0:6460:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79833dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6478:x1873906084485632:12345-0@lo:104:
00010000:00010000:2.0:1787096289.456388:0:6460:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast  ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1787096289.456463:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6478:1873906084485632:0@lo:104:
00010000:00010000:2.0:1787096289.456465:0:6460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool
00000100:00100000:2.0:1787096289.456474:0:6460:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79833dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6478:x1873906084485632:12345-0@lo:104: Request processed in 178us (311us total) trans 0 rc 0/0
00010000:00010000:0.0:1787096289.456479:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.456488:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55
00010000:00010000:2.0:1787096289.456543:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1787096289.456551:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.456562:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ea000 already unused, calling callback (ffffffffc1765ee0)
00010000:00010000:2.0:1787096289.456576:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1787096289.456587:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.456627:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.456637:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:2.0:1787096289.456667:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.456677:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c79830ea000/0x9eebb2eb7f50e055 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50e05c expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.456696:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787096289.456699:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787096289.456702:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787096289.456717:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084485760:0@lo:103:ldlm_bl.0
00000100:00100000:2.0:1787096289.456763:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096289.456829:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084485760
00000100:00100000:2.0:1787096289.456835:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084485760
00010000:00010000:2.0:1787096289.456863:0:6462:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e05c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9eebb2eb7f50e055 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.456906:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83
00000100:00100000:2.0:1787096289.456918:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a90586850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3626:x1873906084485760:12345-0@lo:103:ldlm_bl.0
00010000:00010000:2.0:1787096289.456930:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1787096289.459257:0:7389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1787096289.459268:0:7389:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459299:0:7389:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459306:0:7389:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:0.0:1787096289.459343:0:7389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a82ebb800/0x9eebb2eb7f50dfde lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50dfe5 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1787096289.459408:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967341 is committed
00000100:00100000:2.0:1787096289.459429:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084485888:0@lo:103:jbd2/dm-1-8.0
00000001:00080000:0.0:1787096289.459433:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967340 is committed
00000020:00080000:0.0:1787096289.459459:0:7389:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 6 batchid updated
00000020:00080000:0.0:1787096289.459490:0:7389:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c7983301a80 refcount 2 committed 0 result 0 batchid 7
00000020:00080000:0.0:1787096289.459496:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7983879200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c7983301480
00000100:00100000:2.0:1787096289.459498:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000020:00080000:0.0:1787096289.459500:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump())  cookie [0x200000401:0x3:0x0].7
00000020:00080000:0.0:1787096289.459509:0:7389:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7983879700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c7a863e4c00
00000020:00080000:0.0:1787096289.459512:0:7389:0:(update_trans.c:74:top_multiple_thandle_dump())  cookie [0x240000400:0x3:0x0].7
00010000:00010000:0.0:1787096289.459562:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50dea3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459569:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50dea3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459576:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50dea3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.459577:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084485888
00010000:00010000:0.0:1787096289.459583:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6abe00 already unused, calling callback (ffffffffc17594f0)
00000100:00100000:2.0:1787096289.459587:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084485888
00010000:00010000:0.0:1787096289.459588:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50dea3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459598:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50dea3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459612:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8c7982e5cf00)
00010000:00010000:0.0:1787096289.459615:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1787096289.459620:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50dea3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459625:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50dea3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459659:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50deaa lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.459660:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28
00010000:00010000:0.0:1787096289.459672:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50deaa lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.459680:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3627:x1873906084485888:12345-0@lo:103:jbd2/dm-1-8.0
00010000:00010000:0.0:1787096289.459681:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50deaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.459693:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1787096289.459698:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6ab600 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:0.0:1787096289.459704:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50deaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459714:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50deaa lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.459716:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50dfe5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50dfde expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1787096289.459739:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x7:0x0].0x0 (ffff8c7982e5c100)
00010000:00010000:0.0:1787096289.459743:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1787096289.459748:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50deaa lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.459753:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffff8c7aadca5300)
00010000:00010000:0.0:1787096289.459754:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50deaa lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.459783:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000020:00080000:0.0:1787096289.459812:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 7 committed batchid 6
00000100:00100000:2.0:1787096289.459844:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3627:x1873906084485888:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 167us (349us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096289.459854:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28
00000004:00080000:0.0:1787096289.459944:0:7414:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c79831d7000 with version 18
00000020:00080000:0.0:1787096289.459961:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 6 cancel update log [0x200000401:0x3:0x0].6: rc = 0
00000100:00100000:2.0:1787096289.459964:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084485888:0@lo:103:jbd2/dm-1-8.0
00000020:00080000:0.0:1787096289.460017:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 6 cancel update log [0x240000400:0x3:0x0].6: rc = 0
00000020:00080000:0.0:1787096289.460037:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 6
00000004:00080000:0.0:1787096289.460049:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 18 rpc_version 18
00000020:00100000:0.0:1787096289.460072:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8
00010000:00010000:2.0:1787096289.460073:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e05c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9eebb2eb7f50e055 expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1787096289.460083:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid  req@ffff8c7ab4f74a80 x1873906084486144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:2.0:1787096289.460099:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5c00)
00000100:00100000:0.0:1787096289.460100:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f74a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084486144:0@lo:1000:osp_up0-1.0
00010000:00010000:2.0:1787096289.460111:0:6462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.460122:0:6462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.460130:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1787096289.460146:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1787096289.460184:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7a80 going to sleep for 11 seconds
00010000:00010000:2.0:1787096289.460186:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1787096289.460221:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084486144
00000100:00100000:0.0:1787096289.460232:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084486144
00000100:00100000:2.0:1787096289.460250:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a90586850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084485760:12345-0@lo:103:ldlm_bl.0 Request processed in 3331us (3483us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096289.460268:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83
00000100:00100000:0.0:1787096289.460296:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246
00000100:00100000:0.0:1787096289.460328:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:7405:x1873906084486144:12345-0@lo:1000:osp_up0-1.0
00000100:00100000:2.0:1787096289.460449:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084485760:0@lo:103:ldlm_bl.0
00000100:00100000:0.0:1787096289.460495:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:7405:x1873906084486144:12345-0@lo:1000:osp_up0-1.0 Request processed in 187us (349us total) trans 4294967394 rc 0/0
00010000:00010000:2.0:1787096289.460497:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1787096289.460506:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246
00010000:00010000:2.0:1787096289.460516:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1787096289.460553:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x6:0x0]: returning size 4096
00000004:00200000:2.0:1787096289.460559:0:6478:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2
00000100:00100000:0.0:1787096289.460593:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f74a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084486144:0@lo:1000:osp_up0-1.0
00010000:00010000:2.0:1787096289.460610:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50e09b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4131b expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.460651:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4131b expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.460664:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5c00)
00010000:00010000:2.0:1787096289.460669:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00010000:2.0:1787096289.460673:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763000, rc 0)
00000100:00100000:2.0:1787096289.460727:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37357:x1873906077085440:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 4738us (4848us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096289.460736:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 262
00000100:00100000:0.0:1787096289.461838:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096289.461905:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077085568
00000100:00100000:2.0:1787096289.461912:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077085568
00000100:00100000:2.0:1787096289.461982:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 263
00000100:00100000:2.0:1787096289.461996:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37357:x1873906077085568:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:2.0:1787096289.462009:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1787096289.462021:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0a9 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41322 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462067:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462079:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462090:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462111:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462121:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462130:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462168:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462177:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462185:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462206:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462213:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ea400 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:2.0:1787096289.462217:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462237:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462255:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5c00)
00010000:00010000:2.0:1787096289.462259:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096289.462264:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462273:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50e0b0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462294:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462303:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462310:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462336:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ebc00 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:2.0:1787096289.462340:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462427:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462448:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff8c7a836ec400)
00010000:00010000:2.0:1787096289.462454:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096289.462459:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462467:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0b7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462514:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0a9 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41322 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462527:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5c00)
00010000:00010000:2.0:1787096289.462530:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096289.462536:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0a9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41322 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.462555:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ebe00, rc 0)
00000100:00100000:2.0:1787096289.462605:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37357:x1873906077085568:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 613us (770us total) trans 0 rc 301/301
00000100:00100000:2.0:1787096289.462618:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 263
00000100:00100000:0.0:1787096289.463762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096289.463801:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077085824
00000100:00100000:2.0:1787096289.463808:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077085824
00000100:00100000:2.0:1787096289.463849:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 264
00000100:00100000:2.0:1787096289.463860:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37357:x1873906077085824:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:2.0:1787096289.463880:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1787096289.463882:0:10275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1787096289.463894:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e0a2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4131b expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.463907:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5c00)
00010000:00010000:2.0:1787096289.463915:0:10275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1787096289.463924:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e0be lrc: 2/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41329 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.463978:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.463989:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.463998:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464011:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,1 mode: --/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464019:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464027:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.464126:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10275:1873906084486272:0@lo:1000:mdt00_004.0
00000100:00100000:2.0:1787096289.464158:0:10275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1787096289.464192:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a84fe7540 going to sleep for 11 seconds
00000100:00100000:3.0:1787096289.464212:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084486272
00000100:00100000:3.0:1787096289.464221:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084486272
00000100:00100000:3.0:1787096289.464262:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247
00000100:00100000:3.0:1787096289.464271:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:10275:x1873906084486272:12345-0@lo:1000:mdt00_004.0
00000100:00100000:3.0:1787096289.464395:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:10275:x1873906084486272:12345-0@lo:1000:mdt00_004.0 Request processed in 124us (236us total) trans 0 rc 0/0
00000100:00100000:3.0:1787096289.464404:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247
00000100:00100000:2.0:1787096289.464449:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10275:1873906084486272:0@lo:1000:mdt00_004.0
00010000:00010000:2.0:1787096289.464749:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464761:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464770:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1787096289.464780:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 0
00010000:00010000:2.0:1787096289.464800:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464809:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464816:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464822:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eba00 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:2.0:1787096289.464825:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464833:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464843:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7a836ece00)
00010000:00010000:2.0:1787096289.464846:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1787096289.464850:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464869:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50e0c5 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1787096289.464882:0:10275:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a2f8c356 reply state 00000000cd94e6b3 transno 4294967342 ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464894:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464901:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff8c7a836ec600)
00010000:00010000:2.0:1787096289.464904:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00000100:00100000:2.0:1787096289.464907:0:10275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1787096289.464930:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e0be lrc: 0/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464946:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 7 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.464953:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7a836ecb00)
00010000:00010000:2.0:1787096289.464956:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1787096289.464958:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830eac00, rc 0)
00000100:00100000:2.0:1787096289.464996:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+8:37357:x1873906077085824:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1139us (1233us total) trans 4294967342 rc 0/0
00000100:00100000:2.0:1787096289.465005:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 264
00000100:00100000:0.0:1787096289.466239:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:3.0:1787096289.466278:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077086080
00000100:00100000:3.0:1787096289.466284:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077086080
00000100:00100000:3.0:1787096289.466350:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 265
00000100:00100000:3.0:1787096289.466368:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:37357:x1873906077086080:12345-192.168.201.52@tcp:101:lfs.0
00010000:00010000:3.0:1787096289.466409:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1787096289.466435:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e0e1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41330 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.466515:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.466526:0:8384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 9 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.466534:0:8384:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.466557:0:8384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 9 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.466568:0:8384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 9 pid: 10275 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1787096289.466578:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8384:1873906084486400:192.168.201.52@tcp:104:
00000100:00100000:3.0:1787096289.466688:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983307900 going to sleep for 11 seconds
00000100:00100000:3.0:1787096289.467622:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8384:1873906084486400:192.168.201.52@tcp:104:
00010000:00010000:3.0:1787096289.467685:0:8384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1787096289.467758:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096289.467805:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077086208
00000100:00100000:2.0:1787096289.467812:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077086208
00010000:00010000:2.0:1787096289.467836:0:6464:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 10 pid: 10275 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.467896:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84
00000100:00100000:2.0:1787096289.467907:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+10:2407:x1873906077086208:12345-192.168.201.52@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1787096289.467918:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1787096289.467925:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 10 pid: 10275 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.467938:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 10 pid: 10275 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.467955:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e0d3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41329 expref: 10 pid: 10275 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.467967:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7a836ecb00)
00010000:00010000:2.0:1787096289.467973:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.467982:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.467990:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787096289.468017:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1787096289.468040:0:8384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468049:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1787096289.468057:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+9:2407:x1873906077086208:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 151us (299us total) trans 0 rc 0/0
00000100:00100000:2.0:1787096289.468086:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84
00000004:00200000:3.0:1787096289.468092:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 0
00010000:00010000:3.0:1787096289.468280:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468289:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468295:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468299:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82eba400 already unused, calling callback (ffffffffc17594f0)
00010000:00010000:3.0:1787096289.468303:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468309:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468351:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7a836ecb00)
00010000:00010000:3.0:1787096289.468376:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:3.0:1787096289.468381:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468386:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e0e8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468414:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e0e1 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41330 expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468420:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7a836ecb00)
00010000:00010000:3.0:1787096289.468422:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1787096289.468431:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e0e1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41330 expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1787096289.468442:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebaa00, rc 0)
00000100:00100000:3.0:1787096289.468473:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+7:37357:x1873906077086080:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2106us (2235us total) trans 0 rc 301/301
00000100:00100000:3.0:1787096289.468480:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 265
00000100:00100000:0.0:1787096289.469402:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp)
00000100:00100000:2.0:1787096289.469443:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077086464
00000100:00100000:2.0:1787096289.469455:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077086464
00000100:00100000:2.0:1787096289.469498:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51
00000100:00100000:2.0:1787096289.469510:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+7:37357:x1873906077086464:12345-192.168.201.52@tcp:35:lfs.0
00000100:00100000:2.0:1787096289.469646:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+8:37357:x1873906077086464:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 138us (243us total) trans 4294967343 rc 0/0
00000100:00100000:2.0:1787096289.469655:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51
00010000:00010000:0.0:1787096289.969519:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:02000400:2.0:1787096290.078644:0:23284:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_26a: @@@@@@ FAIL: setstripe failed
Debug log: 1110 lines, 1110 kept, 0 dropped, 0 bad.