00000100:00100000:2.0F:1787096603.743937:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0F:1787096603.743985:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345552000 00000100:00100000:0.0:1787096603.744002:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345552000 00000100:00080000:3.0F:1787096603.744061:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096603.744090:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 347 00000100:00100000:0.0:1787096603.744105:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+8:39027:x1873906345552000:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1787096603.744136:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096603.744161:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166cd54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b23f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.744233:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166cd5b lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.744245:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166cd5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.744256:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166cd5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096603.744363:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787096603.744369:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787096603.744392:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166cd5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.744418:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166cd54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23f2 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.744466:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166cd5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23f2 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.744476:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff961742a27200) 00010000:00010000:0.0:1787096603.744480:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096603.744485:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e800, rc 0) 00000100:00100000:0.0:1787096603.744580:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+9:39027:x1873906345552000:12345-192.168.201.40@tcp:101:rm.0 Request processed in 479us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.744588:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 347 00000100:00100000:0.0:1787096603.745751:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096603.745798:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345552128 00000100:00100000:2.0:1787096603.745806:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345552128 00000100:00100000:2.0:1787096603.745865:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 348 00000100:00080000:3.0:1787096603.745867:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096603.745878:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+13:39027:x1873906345552128:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096603.745896:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096603.745925:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e600/0xa979d75fc166cd62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b23f9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.745978:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92fa00/0xa979d75fc166cd69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.745990:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92fa00/0xa979d75fc166cd69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.746003:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92fa00/0xa979d75fc166cd69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096603.746040:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1787096603.746045:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096603.746075:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e600/0xa979d75fc166cd62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23f9 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.746086:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92fa00/0xa979d75fc166cd69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23f9 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.746092:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff961742a25900) 00010000:00010000:2.0:1787096603.746094:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096603.746096:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96187c92fa00, rc 0) 00000100:00100000:2.0:1787096603.746141:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+14:39027:x1873906345552128:12345-192.168.201.40@tcp:101:rm.0 Request processed in 267us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096603.746158:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 348 00000100:00100000:2.0:1787096603.750300:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096603.750353:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345552256 00000100:00100000:3.0:1787096603.750378:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345552256 00000100:00100000:3.0:1787096603.750468:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 71 00000100:00100000:3.0:1787096603.750481:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+9:39027:x1873906345552256:12345-192.168.201.40@tcp:37:rm.0 00000100:00100000:3.0:1787096603.756490:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+9:39027:x1873906345552256:12345-192.168.201.40@tcp:37:rm.0 Request processed in 6000us (6187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096603.756514:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 71 00000100:00100000:0.0:1787096603.758795:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0F:1787096603.758837:0:6491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345552384 00000100:00100000:1.0:1787096603.758856:0:6491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345552384 00000100:00100000:1.0:1787096603.758913:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 72 00000100:00100000:1.0:1787096603.758923:0:6491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+14:39027:x1873906345552384:12345-192.168.201.40@tcp:37:rm.0 00000100:00100000:1.0:1787096603.761339:0:6491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+14:39027:x1873906345552384:12345-192.168.201.40@tcp:37:rm.0 Request processed in 2405us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096603.761354:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 72 00000100:00100000:2.0:1787096603.763515:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096603.763564:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345552512 00000100:00100000:0.0:1787096603.763576:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345552512 00000100:00100000:0.0:1787096603.763654:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 349 00000100:00100000:0.0:1787096603.763673:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+14:39027:x1873906345552512:12345-192.168.201.40@tcp:41:rm.0 00000004:00000024:0.0:1787096603.763742:0:6490:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7846535168 avail 7382941696 00000100:00100000:0.0:1787096603.763817:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+14:39027:x1873906345552512:12345-192.168.201.40@tcp:41:rm.0 Request processed in 149us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.763826:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 349 00000100:00100000:0.0:1787096603.765035:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096603.765082:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345552640 00000100:00100000:2.0:1787096603.765088:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345552640 00000100:00100000:2.0:1787096603.765125:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 350 00000100:00100000:2.0:1787096603.765135:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+14:39027:x1873906345552640:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096603.765150:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096603.765174:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92fc00/0xa979d75fc166cd70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2400 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765244:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765260:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765271:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765284:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765289:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765293:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765376:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92f200/0xa979d75fc166cd85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765393:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92f200/0xa979d75fc166cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765401:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92f200/0xa979d75fc166cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096603.765477:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 3145729 00000004:00200000:2.0:1787096603.765481:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096603.765499:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92f200/0xa979d75fc166cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765528:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92f200/0xa979d75fc166cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765538:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765545:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765553:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765560:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96187c92e200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096603.765564:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765574:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765585:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff961742a25900) 00010000:00010000:2.0:1787096603.765594:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096603.765600:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765605:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92e200/0xa979d75fc166cd77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765614:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765618:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765622:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765625:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96187c92ea00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096603.765627:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765630:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765634:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0xc0870d27 (ffff961742a25400) 00010000:00010000:2.0:1787096603.765635:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096603.765637:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765640:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cd7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765674:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92fc00/0xa979d75fc166cd70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2400 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765710:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92f200/0xa979d75fc166cd85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2400 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.765717:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff961742a25800) 00010000:00010000:2.0:1787096603.765719:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096603.765722:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96187c92f200, rc 0) 00000100:00100000:2.0:1787096603.765777:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+15:39027:x1873906345552640:12345-192.168.201.40@tcp:101:rm.0 Request processed in 643us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096603.765785:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 350 00000100:00100000:2.0:1787096603.767663:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096603.767719:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345552896 00000100:00100000:0.0:1787096603.767729:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345552896 00000100:00100000:0.0:1787096603.767791:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 351 00000100:00100000:0.0:1787096603.767803:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+15:39027:x1873906345552896:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1787096603.767856:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787096603.767888:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92f200/0xa979d75fc166cd85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2400 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.767911:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ccac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23c1 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.767922:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff961742a25800) 00010000:00010000:0.0:1787096603.767943:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92fa00/0xa979d75fc166cd69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23f9 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.767961:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff961742a25900) 00010000:00010000:0.0:1787096603.767970:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096603.767993:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768005:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768015:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768029:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768045:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768053:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768128:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768137:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768145:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787096603.768463:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8760 00000004:00080000:0.0:1787096603.768473:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286218032294ns, next at 287218030151ns, rc = 0 00000040:00080000:0.0:1787096603.768499:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8824 00000004:00080000:0.0:1787096603.768516:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286218075261ns, next at 287218073521ns, rc = 0 00000040:00080000:0.0:1787096603.768530:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8824 00000040:00080000:0.0:1787096603.768540:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 64 off8888 00010000:00010000:0.0:1787096603.768599:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768607:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768613:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768619:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768623:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768627:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768647:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787096603.768666:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768672:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768677:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768684:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096603.768694:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768703:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768713:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff961741932400) 00010000:00010000:0.0:1787096603.768716:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096603.768719:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768726:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cd9a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768743:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768750:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768757:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768763:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768768:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096603.768771:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768776:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768788:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff961741932a00) 00010000:00010000:0.0:1787096603.768790:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096603.768792:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 3/0,0 mode: --/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768796:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166cd8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096603.768807:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009b10d3f7 reply state 00000000cb3e28b7 transno 4294967432 ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768818:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.768825:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0xc0870d27 (ffff961741932e00) 00010000:00010000:0.0:1787096603.768827:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096603.768831:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787096603.768912:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+14:39027:x1873906345552896:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1110us (1254us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787096603.768923:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 351 00010000:00010000:1.0:1787096603.768926:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096603.768936:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.768945:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e600 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:1.0:1787096603.768950:0:10297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.768957:0:10297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.768969:0:10297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff961741932400) 00010000:00010000:1.0:1787096603.768972:0:10297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096603.768976:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.768982:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cda1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.768999:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096603.769002:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096603.769004:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096603.770467:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096603.770523:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096603.770527:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345553024 00000100:00100000:3.0:1787096603.770538:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345553024 00000100:00100000:2.0:1787096603.770569:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345553280 00000100:00100000:2.0:1787096603.770575:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345553280 00000100:00100000:3.0:1787096603.770610:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 34 00000100:00100000:2.0:1787096603.770619:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 73 00000100:00100000:3.0:1787096603.770625:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+14:2403:x1873906345553024:12345-192.168.201.40@tcp:103:rm.0 00000100:00100000:2.0:1787096603.770632:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96185818dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+9:39027:x1873906345553280:12345-192.168.201.40@tcp:35:rm.0 00010000:00010000:3.0:1787096603.770641:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096603.770662:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166c94f lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22cc expref: 14 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.770678:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff961742a27400) 00010000:00010000:3.0:1787096603.770690:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096603.770743:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+13:2403:x1873906345553024:12345-192.168.201.40@tcp:103:rm.0 Request processed in 123us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096603.770752:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 34 00000040:00080000:2.0:1787096603.770945:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].10, 344 off47616 00000040:00080000:2.0:1787096603.771017:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].10, 424 off49016 00000004:00080000:2.0:1787096603.771025:0:6492:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961742d74000 with version 21 00000004:00080000:0.0:1787096603.771069:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 21 rpc_version 21 00000020:00100000:0.0:1787096603.771103:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096603.771113:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96187552a300 x1873906354009728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096603.771141:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187552a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354009728:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096603.771201:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096603.771255:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354009728 00000100:00100000:3.0:1787096603.771260:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354009728 00000100:00100000:0.0:1787096603.771268:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961858963900 going to sleep for 11 seconds 00000100:00100000:3.0:1787096603.771300:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787096603.771310:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7416:x1873906354009728:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096603.771533:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7416:x1873906354009728:12345-0@lo:1000:osp_up0-1.0 Request processed in 225us (331us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787096603.771552:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787096603.771588:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187552a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354009728:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096603.771683:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96185818dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+10:39027:x1873906345553280:12345-192.168.201.40@tcp:35:rm.0 Request processed in 1048us (1153us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787096603.771693:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 73 00000100:00100000:0.0:1787096603.773680:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096603.773734:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345553536 00000100:00100000:3.0:1787096603.773743:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345553536 00000100:00100000:3.0:1787096603.773795:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 352 00000100:00100000:3.0:1787096603.773808:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+10:39027:x1873906345553536:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1787096603.773880:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787096603.773910:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96187c92e400/0xa979d75fc166ca21 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2312 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.773936:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166cd5b lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23f2 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.773955:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c95d lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22d3 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.773968:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff961742a27200) 00010000:00010000:3.0:1787096603.773983:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096603.774035:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.774044:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.774055:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096603.774090:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743417100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354009856:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787096603.774149:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096603.774200:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354009856 00000100:00100000:3.0:1787096603.774201:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618482a6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787096603.774207:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354009856 00000100:00100000:0.0:1787096603.774250:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787096603.774261:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6490:x1873906354009856:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787096603.774277:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096603.774294:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166cda8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.774321:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c933 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22c5 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.774332:0:6494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166cda8 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.774379:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22c5 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.774395:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22c5 expref: 12 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096603.774407:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187552a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906354009984:192.168.201.40@tcp:104: 00000100:00100000:0.0:1787096603.774515:0:6494:0:(client.c:2692:ptlrpc_set_wait()) set ffff961858963900 going to sleep for 11 seconds 00000100:00100000:0.0:1787096603.775846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096603.775895:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345553664 00000100:00100000:2.0:1787096603.775903:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345553664 00010000:00010000:2.0:1787096603.775936:0:6473:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c933 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22c5 expref: 13 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096603.775977:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 104 00000100:00100000:2.0:1787096603.775997:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618589c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+13:2400:x1873906345553664:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096603.776010:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096603.776017:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c933 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22c5 expref: 13 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776044:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22c5 expref: 13 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776065:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:2.0:1787096603.776072:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166cda8 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776083:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xa979d75fc166cda8 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776092:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xa979d75fc166cda8 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776121:0:6473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166cda8 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096603.776133:0:6473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6473:1873906354010112:0@lo:105: 00000100:00100000:2.0:1787096603.776167:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096603.776175:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c933 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22c5 expref: 13 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096603.776195:0:6494:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187552a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906354009984:192.168.201.40@tcp:104: 00000100:00100000:2.0:1787096603.776202:0:6473:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d74480 going to sleep for 11 seconds 00010000:00010000:3.0:1787096603.776224:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166cda8 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.776234:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:3.0:1787096603.776237:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096603.776241:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340ea00, rc 0) 00000100:00100000:0.0:1787096603.776252:0:7411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354010112 00000100:00100000:0.0:1787096603.776262:0:7411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354010112 00000100:00100000:0.0:1787096603.776296:0:7411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787096603.776301:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6490:x1873906354009856:12345-0@lo:101:mdt00_002.0 Request processed in 2041us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.776304:0:7411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6473:x1873906354010112:12345-0@lo:105: 00000100:00100000:3.0:1787096603.776317:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:0.0:1787096603.776319:0:7411:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.776331:0:7411:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.776340:0:7411:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.776349:0:7411:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.776358:0:7411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.776368:0:7411:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.776385:0:7411:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff961840030c00) 00000100:00100000:0.0:1787096603.776418:0:7411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6473:x1873906354010112:12345-0@lo:105: Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.776423:0:7411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787096603.776435:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743417100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354009856:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787096603.776474:0:6473:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742cc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6473:1873906354010112:0@lo:105: 00010000:00010000:2.0:1787096603.776478:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.776486:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1787096603.776525:0:6490:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787096603.776535:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618589c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+12:2400:x1873906345553664:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 541us (690us total) trans 0 rc 0/0 00010000:00010000:2.0:1787096603.776552:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096603.776561:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 104 00010000:00010000:2.0:1787096603.776564:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776575:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096603.776591:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742cc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010240:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1787096603.776619:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096603.776634:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d74480 going to sleep for 11 seconds 00000100:00100000:2.0:1787096603.776653:0:23023:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354010240 00000100:00100000:2.0:1787096603.776657:0:23023:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354010240 00000100:00100000:2.0:1787096603.776689:0:23023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787096603.776698:0:23023:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6490:x1873906354010240:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787096603.776714:0:23023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096603.776738:0:23023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cdbd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166cdb6 expref: -99 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776758:0:23023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cdbd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166cdb6 expref: 11 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776768:0:23023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cdbd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166cdb6 expref: 11 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.776775:0:23023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffff961742a25c00) 00010000:00010000:2.0:1787096603.776784:0:23023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096603.776787:0:23023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96187c92ea00, rc 0) 00000100:00100000:2.0:1787096603.776819:0:23023:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6490:x1873906354010240:12345-0@lo:101:mdt00_002.0 Request processed in 123us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096603.776825:0:23023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787096603.776851:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742cc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010240:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787096603.776863:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.776873:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096603.776895:0:6490:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787096603.776946:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010368:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787096603.776976:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096603.777003:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff9617434573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096603.777114:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354010368 00000100:00100000:2.0:1787096603.777118:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354010368 00000100:00100000:2.0:1787096603.777140:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787096603.777146:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6490:x1873906354010368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787096603.777207:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6490:x1873906354010368:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096603.777215:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787096603.777225:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010368:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787096603.777266:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010496:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787096603.777300:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096603.777320:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff961743457b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787096603.777347:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354010496 00000100:00100000:0.0:1787096603.777352:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354010496 00000100:00100000:0.0:1787096603.777384:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787096603.777393:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6490:x1873906354010496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787096603.777517:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6490:x1873906354010496:12345-0@lo:1000:mdt00_002.0 Request processed in 125us (215us total) trans 0 rc 1/1 00000100:00100000:0.0:1787096603.777526:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787096603.777535:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010496:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787096603.777579:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777587:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777594:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096603.777605:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010624:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787096603.777626:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096603.777644:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff9617434573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096603.777666:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354010624 00000100:00100000:0.0:1787096603.777670:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354010624 00000100:00100000:0.0:1787096603.777701:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787096603.777707:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6490:x1873906354010624:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787096603.777716:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096603.777735:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cdcb lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166cdc4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.777752:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cdcb lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166cdc4 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.777762:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cdcb lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166cdc4 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.777770:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff961741932a00) 00010000:00010000:0.0:1787096603.777773:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096603.777775:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e000, rc 0) 00000100:00100000:0.0:1787096603.777803:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6490:x1873906354010624:12345-0@lo:101:mdt00_002.0 Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096603.777819:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010624:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787096603.777820:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:3.0:1787096603.777835:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777845:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777871:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777880:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777890:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777921:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777932:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ba00/0xa979d75fc166c96b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22da expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777941:0:6490:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777963:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ba00/0xa979d75fc166c96b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22da expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.777977:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ba00/0xa979d75fc166c96b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22da expref: 7 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096603.777989:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6490:1873906354010752:192.168.201.40@tcp:104: 00000100:00100000:3.0:1787096603.778044:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff9617434573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096603.781851:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096603.781858:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6490:1873906354010752:192.168.201.40@tcp:104: 00010000:00010000:2.0:1787096603.781891:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096603.782069:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345553792 00000100:00100000:1.0:1787096603.782078:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345553792 00010000:00010000:1.0:1787096603.782123:0:8380:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ba00/0xa979d75fc166c96b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22da expref: 8 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096603.782176:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 105 00000100:00100000:1.0:1787096603.782189:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+8:2401:x1873906345553792:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096603.782208:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096603.782215:0:8380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ba00/0xa979d75fc166c96b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22da expref: 8 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.782230:0:8380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ba00/0xa979d75fc166c96b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22da expref: 8 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.782257:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ba00/0xa979d75fc166c96b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b22da expref: 8 pid: 6490 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.782274:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffff961742a27d00) 00010000:00010000:1.0:1787096603.782280:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.782290:0:8380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.782299:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096603.782332:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096603.782379:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.782388:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096603.782425:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187552ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+7:2401:x1873906345553792:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 238us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096603.782433:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 105 00010000:00010000:2.0:1787096603.782471:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.782481:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.782492:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096603.782535:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010880:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1787096603.782582:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096603.782618:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d74840 going to sleep for 11 seconds 00000100:00100000:0.0:1787096603.782661:0:23023:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354010880 00000100:00100000:0.0:1787096603.782666:0:23023:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354010880 00000100:00100000:0.0:1787096603.782707:0:23023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787096603.782714:0:23023:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:6490:x1873906354010880:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787096603.782731:0:23023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096603.782752:0:23023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166cde7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166cde0 expref: -99 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.782776:0:23023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166cde7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166cde0 expref: 13 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.782789:0:23023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166cde7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166cde0 expref: 13 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.782794:0:23023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff961741932500) 00010000:00010000:0.0:1787096603.782796:0:23023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096603.782798:0:23023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e400, rc 0) 00000100:00100000:0.0:1787096603.782840:0:23023:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6490:x1873906354010880:12345-0@lo:101:mdt00_002.0 Request processed in 126us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.782847:0:23023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787096603.782940:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354010880:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787096603.782955:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.782967:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096603.783791:0:6490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354011008:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1787096603.783827:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096603.783848:0:6490:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d74840 going to sleep for 11 seconds 00000100:00100000:0.0:1787096603.783951:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354011008 00000100:00100000:0.0:1787096603.783958:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354011008 00000100:00100000:0.0:1787096603.783996:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787096603.784006:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6490:x1873906354011008:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1787096603.786028:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6490:x1873906354011008:12345-0@lo:403:mdt00_002.0 Request processed in 2016us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.786045:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787096603.786872:0:6490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6490:1873906354011008:0@lo:403:mdt00_002.0 00000040:00080000:2.0:1787096603.787993:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].11, 936 off48552 00000040:00080000:2.0:1787096603.788167:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].11, 1016 off50032 00000004:00080000:2.0:1787096603.788173:0:6490:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961742d74600 with version 22 00000004:00080000:0.0:1787096603.788214:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 22 rpc_version 22 00000020:00100000:0.0:1787096603.788252:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096603.788267:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96187552a680 x1873906354011264/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2336/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096603.788292:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187552a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354011264:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096603.788358:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096603.788406:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618589630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096603.788428:0:23023:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354011264 00000100:00100000:2.0:1787096603.788436:0:23023:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354011264 00000100:00100000:2.0:1787096603.788524:0:23023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787096603.788535:0:23023:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618581f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:7416:x1873906354011264:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096603.788906:0:23023:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618581f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:7416:x1873906354011264:12345-0@lo:1000:osp_up0-1.0 Request processed in 374us (547us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787096603.788915:0:23023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787096603.789088:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187552a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354011264:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1787096603.789126:0:6490:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787096603.789153:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789164:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789173:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789180:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096603.789192:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789201:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789219:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffff961742a27d00) 00010000:00010000:3.0:1787096603.789223:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096603.789229:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789237:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166cdd9 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789262:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789272:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789280:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789303:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787096603.789310:0:6490:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x8:0x0] 00010000:00010000:3.0:1787096603.789319:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789325:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789332:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789343:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840031000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096603.789346:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789353:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789362:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff96184a9eaf00) 00010000:00010000:3.0:1787096603.789365:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096603.789368:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789374:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961840031000/0xa979d75fc166cdd2 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789396:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789407:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789414:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789431:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787096603.789484:0:6476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:3.0:1787096603.789495:0:6490:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096603.789498:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789518:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96187c92e200 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:2.0:1787096603.789523:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096603.789529:0:6476:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789542:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789553:0:6476:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789565:0:6476:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096603.789582:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789589:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789596:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789603:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92e200/0xa979d75fc166cde0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cde7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789610:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1787096603.789616:0:6490:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096603.789617:0:6476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787096603.789621:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789623:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789631:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030e00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096603.789637:0:6477:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096603.789638:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096603.789639:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096603.789652:0:6476:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.789657:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.789675:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030c00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096603.789680:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789685:0:6476:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096603.789689:0:6477:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789690:0:6476:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096603.789697:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 1/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789706:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030e00/0xa979d75fc166cdc4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdcb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.789728:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096603.789729:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+7:39027:x1873906345553536:12345-192.168.201.40@tcp:36:rm.0 Request processed in 15921us (16056us total) trans 4294967358 rc 0/0 00010000:00010000:2.0:1787096603.789730:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096603.789734:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096603.789735:0:6477:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096603.789740:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 352 00000100:00100000:2.0:1787096603.789746:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354011392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096603.789752:0:6477:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096603.789775:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096603.789780:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787096603.789787:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961840030c00/0xa979d75fc166cda8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdaf expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.789811:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096603.789813:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096603.789816:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787096603.789816:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096603.789822:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354011520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096603.789831:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961875528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354011648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096603.789840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787096603.789863:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096603.789864:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096603.789887:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354011392 00000100:00100000:2.0:1787096603.789892:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354011392 00000100:00100000:0.0:1787096603.789934:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354011520 00000100:00100000:2.0:1787096603.789939:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354011648 00000100:00100000:0.0:1787096603.789939:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354011520 00000100:00100000:2.0:1787096603.789944:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354011648 00000100:00100000:0.0:1787096603.789976:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787096603.789984:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787096603.789987:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+16:3636:x1873906354011392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096603.789998:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+16:3636:x1873906354011520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096603.790000:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096603.790009:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096603.790021:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166cde7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166cde0 expref: 16 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096603.790025:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166cdcb lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166cdc4 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.790033:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff961741932500) 00010000:00010000:0.0:1787096603.790046:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096603.790051:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffff961741932a00) 00010000:00010000:2.0:1787096603.790061:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096603.790076:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3636:x1873906354011392:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.790083:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787096603.790095:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3636:x1873906354011520:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.790100:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787096603.790110:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787096603.790111:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3634:x1873906354011648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096603.790123:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096603.790134:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166cdaf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166cda8 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096603.790144:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096603.790152:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096603.790158:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354011520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096603.790183:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354011392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096603.790192:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3634:x1873906354011648:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096603.790199:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787096603.790230:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961875528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354011648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096603.919587:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096604.467077:0:23994:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 19:43:23 (1787096603) 00010000:00010000:2.0:1787096604.942797:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096604.960432:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096604.960500:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345553920 00000100:00100000:3.0:1787096604.960512:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345553920 00000100:00100000:0.0:1787096604.960523:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096604.960562:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096604.960565:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554048 00000100:00100000:1.0:1787096604.960571:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554048 00000100:00100000:3.0:1787096604.960575:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 334 00000100:00100000:3.0:1787096604.960589:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2402:x1873906345553920:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1787096604.960600:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096604.960615:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554176 00000100:00100000:1.0:1787096604.960618:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554176 00000100:00100000:1.0:1787096604.960646:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 312 00000100:00100000:1.0:1787096604.960659:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+12:2403:x1873906345554048:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1787096604.960663:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096604.960667:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2402:x1873906345553920:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096604.960677:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 334 00000100:00100000:1.0:1787096604.960708:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+12:2403:x1873906345554048:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096604.960716:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 312 00000100:00100000:3.0:1787096604.960734:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554304 00000100:00100000:1.0:1787096604.960738:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 313 00000100:00100000:3.0:1787096604.960740:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554304 00000100:00100000:1.0:1787096604.960746:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187552b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+7:2402:x1873906345554176:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096604.960777:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187552b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+7:2402:x1873906345554176:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096604.960784:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 313 00000100:00100000:3.0:1787096604.960796:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554432 00000100:00100000:3.0:1787096604.960800:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554432 00000100:00100000:1.0:1787096604.960817:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 137 00000100:00100000:1.0:1787096604.960827:0:8456:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70e19547-606a-4706-b016-3476e377d7df+8:2403:x1873906345554304:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096604.960850:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 138 00000100:00100000:1.0:1787096604.960858:0:8456:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70e19547-606a-4706-b016-3476e377d7df+8:2403:x1873906345554304:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 34us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096604.960867:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 137 00000100:00100000:3.0:1787096604.960938:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70e19547-606a-4706-b016-3476e377d7df+8:2402:x1873906345554432:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096604.960968:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70e19547-606a-4706-b016-3476e377d7df+8:2402:x1873906345554432:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096604.960974:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 138 00000100:00080000:3.0:1787096604.960994:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096604.960998:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787096605.128941:0:24042:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27b needs >= 8 OSTs 00000004:00080000:0.0:1787096605.262636:0:10000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 287712192663ns, next at 288712189473ns, rc = 0 00000100:00100000:1.0:1787096605.262646:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354011904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096605.262680:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906354012288:0@lo:400:kworker.0 00000100:00100000:2.0:1787096605.262717:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1873906354012032:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.262726:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096605.262761:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096605.262782:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef59912-d6a3-4393-bae9-348c8f3519b6:3635:1873906354011776:0@lo:400:kworker.0 00000100:00100000:2.0:1787096605.262788:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1873906354012544:0@lo:400:kworker.0 00000100:00100000:2.0:1787096605.262880:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096605.262907:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1873906354013056:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.262931:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096605.262943:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096605.263019:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906354012416:0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.263031:0:8453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354011904 00000100:00100000:0.0:1787096605.263039:0:8453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354011904 00000100:00100000:1.0:1787096605.263056:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354011776 00000100:00100000:1.0:1787096605.263062:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354011776 00000100:00100000:0.0:1787096605.263092:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787096605.263100:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787096605.263104:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1873906354011904:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096605.263111:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3635:x1873906354011776:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787096605.263134:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25042624 pending 1073152 free 3921956864 avail 3690434560 00000100:00100000:1.0:1787096605.263159:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3635:x1873906354011776:12345-0@lo:400:kworker.0 Request processed in 50us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096605.263167:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787096605.263190:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1873906354011904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096605.263197:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1787096605.263214:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787096605.264530:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354012160:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.264621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096605.264645:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354012672:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.264668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096605.264685:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906354013184:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.264723:0:8364:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012672 00000100:00100000:1.0:1787096605.264727:0:8364:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012672 00000100:00100000:1.0:1787096605.264764:0:8364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787096605.264771:0:8364:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906354012672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.264812:0:8364:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906354012672:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096605.264818:0:8364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787096605.264837:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012160 00000100:00100000:1.0:1787096605.264840:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012160 00000100:00100000:1.0:1787096605.264865:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787096605.264884:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3637:x1873906354012160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.264919:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3637:x1873906354012160:12345-0@lo:400:kworker.0 Request processed in 48us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096605.264934:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:1.0:1787096605.264953:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096605.266582:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012032 00000100:00100000:3.0:1787096605.266591:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012032 00000100:00100000:0.0:1787096605.266602:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012544 00000100:00100000:0.0:1787096605.266608:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012544 00000100:00100000:3.0:1787096605.266641:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354013056 00000100:00100000:3.0:1787096605.266646:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354013056 00000100:00100000:2.0:1787096605.266653:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354013568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096605.266657:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787096605.266666:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787096605.266668:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1873906354012032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.266682:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1873906354012544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096605.266686:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787096605.266697:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1873906354013056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.267010:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1873906354012544:12345-0@lo:400:kworker.0 Request processed in 332us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096605.267018:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787096605.267042:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1873906354012032:12345-0@lo:400:kworker.0 Request processed in 376us (4280us total) trans 0 rc 0/0 00000100:00080000:1.0:1787096605.267044:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096605.267049:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096605.267067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096605.267072:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787096605.267080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096605.267095:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354013184 00000100:00100000:0.0:1787096605.267100:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354013184 00000100:00100000:1.0:1787096605.267115:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354012160:0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.267133:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787096605.267137:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1873906354012032:0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.267154:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906354013184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096605.267169:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1873906354013056:12345-0@lo:400:kworker.0 Request processed in 472us (4224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096605.267176:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787096605.267226:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354013568 00000100:00100000:3.0:1787096605.267230:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354013568 00000100:00100000:3.0:1787096605.267258:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787096605.267264:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906354013568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096605.267279:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25042624 pending 1073152 free 3921956864 avail 3690434560 00000100:00100000:1.0:1787096605.268030:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354012672:0@lo:400:kworker.0 00000100:00080000:1.0:1787096605.268064:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787096605.268068:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096605.268080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096605.268107:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354012928:0@lo:400:kworker.0 00000100:00100000:2.0:1787096605.268129:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1873906354012544:0@lo:400:kworker.0 00000100:00100000:2.0:1787096605.268149:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1873906354013056:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.268157:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096605.268161:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906354013568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 893us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096605.268171:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787096605.268188:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354013440:0@lo:400:kworker.0 00000100:00100000:2.0:1787096605.268200:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354013568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096605.268205:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906354013184:12345-0@lo:400:kworker.0 Request processed in 1062us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096605.268207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096605.268221:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096605.268222:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787096605.268244:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012416 00000100:00100000:3.0:1787096605.268245:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354012800:0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.268250:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012416 00000100:00100000:1.0:1787096605.268267:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354011904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096605.268284:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef59912-d6a3-4393-bae9-348c8f3519b6:3635:1873906354011776:0@lo:400:kworker.0 00000100:00100000:3.0:1787096605.268292:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096605.268293:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012288 00000100:00100000:0.0:1787096605.268297:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012288 00000100:00100000:1.0:1787096605.268322:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012928 00000100:00100000:0.0:1787096605.268323:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354012800 00000100:00100000:3.0:1787096605.268327:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354013312:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.268329:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012928 00000100:00100000:0.0:1787096605.268329:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354012800 00000100:00100000:3.0:1787096605.268360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096605.268368:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787096605.268373:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354013440 00000100:00100000:1.0:1787096605.268377:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354013440 00000100:00100000:0.0:1787096605.268380:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906354012800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.268417:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354013312 00000100:00100000:1.0:1787096605.268421:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354013312 00000100:00100000:2.0:1787096605.268427:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787096605.268458:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787096605.268461:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906354012800:12345-0@lo:400:kworker.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096605.268468:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906354012416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096605.268471:0:8456:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3635:x1873906354012928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.268486:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787096605.268488:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787096605.268504:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1873906354013440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.268514:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787096605.268522:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906354012288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096605.268549:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906354012416:12345-0@lo:400:kworker.0 Request processed in 112us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096605.268550:0:8456:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3635:x1873906354012928:12345-0@lo:400:kworker.0 Request processed in 84us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096605.268566:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787096605.268568:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787096605.268568:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1873906354013440:12345-0@lo:400:kworker.0 Request processed in 65us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096605.268572:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906354012288:12345-0@lo:400:kworker.0 Request processed in 49us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096605.268585:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787096605.268589:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787096605.268596:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787096605.268606:0:8456:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906354013312:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787096605.268618:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787096605.268624:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096605.268624:0:3634:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:0.0:1787096605.268630:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967345 committed transno 4294967353 00000020:00080000:0.0:1787096605.268636:0:3634:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96186dd07000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787096605.268644:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742c6f800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96186dd07e40 00000100:00100000:3.0:1787096605.268648:0:8456:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906354013312:12345-0@lo:400:kworker.0 Request processed in 42us (284us total) trans 0 rc 0/0 00000020:00080000:0.0:1787096605.268648:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].6 00000020:00080000:0.0:1787096605.268652:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742c6f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961875608600 00000020:00080000:0.0:1787096605.268659:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].6 00000100:00100000:3.0:1787096605.268664:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787096605.268664:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906354013184:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.268700:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906354012416:0@lo:400:kworker.0 00000020:00080000:2.0:1787096605.268704:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000100:00100000:1.0:1787096605.268712:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354012928:0@lo:400:kworker.0 00000100:00100000:1.0:1787096605.268721:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354013440:0@lo:400:kworker.0 00000004:00080000:0.0:1787096605.268778:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967346 committed transno 4294967353 00000020:00080000:0.0:1787096605.268781:0:3634:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961742a35540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787096605.268784:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742c6f300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961742a35e40 00000020:00080000:0.0:1787096605.268785:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].7 00000020:00080000:0.0:1787096605.268787:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742c6fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742a33600 00000020:00080000:1.0:1787096605.268789:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787096605.268789:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].7 00000020:00080000:1.0:1787096605.268794:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000004:00080000:0.0:1787096605.268808:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967347 committed transno 4294967353 00000020:00080000:1.0:1787096605.268819:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:0.0:1787096605.268829:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967351 committed transno 4294967353 00000020:00080000:0.0:1787096605.268833:0:3634:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961846d0c480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787096605.268836:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961846d0c840 00000020:00080000:0.0:1787096605.268838:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].8 00000020:00080000:0.0:1787096605.268840:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742ca5400 00000020:00080000:0.0:1787096605.268843:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].8 00000004:00080000:0.0:1787096605.268866:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967353 committed transno 4294967353 00000100:00100000:0.0:1787096605.268877:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354012800:0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.268891:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354013312:0@lo:400:kworker.0 00000100:00100000:0.0:1787096605.268901:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906354012288:0@lo:400:kworker.0 00000020:00080000:1.0:1787096605.269380:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1787096605.269398:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787096605.778842:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787096605.778920:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354013696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787096605.778983:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096605.779274:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354013696 00000100:00100000:1.0:1787096605.779282:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354013696 00000100:00100000:1.0:1787096605.779328:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787096605.779336:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3636:x1873906354013696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787096605.779368:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:1.0:1787096605.779415:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3636:x1873906354013696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096605.779422:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787096605.779544:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354013696:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787096605.925763:0:24090:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27c: test creating with n+2 OSTs ======= 19:43:24 (1787096604) 00010000:00010000:1.0:1787096605.967398:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096606.698281:0:24138:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27c needs >= 8 OSTs 00010000:00010000:2.0:1787096606.993623:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787096607.313898:0:9432:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787096607.313916:0:9432:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000020:00080000:1.0:1787096607.314862:0:6467:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787096607.314868:0:6467:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787096607.314870:0:6467:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:0.0:1787096607.314901:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00080000:0.0:1787096607.314947:0:6520:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961742c43540 with version 17 00000020:00080000:0.0:1787096607.314967:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 6 cancel update log [0x240000401:0x3:0x0].6: rc = 0 00000020:00080000:0.0:1787096607.315026:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 6 cancel update log [0x200000400:0x3:0x0].6: rc = 0 00000004:00080000:0.0:1787096607.315041:0:6520:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961742c43000 with version 18 00000020:00080000:0.0:1787096607.315043:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 7 cancel update log [0x240000401:0x3:0x0].7: rc = 0 00000020:00080000:0.0:1787096607.315053:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 7 cancel update log [0x200000400:0x3:0x0].7: rc = 0 00000004:00080000:0.0:1787096607.315064:0:6520:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961742c433c0 with version 19 00000020:00080000:0.0:1787096607.315066:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8 cancel update log [0x240000401:0x3:0x0].8: rc = 0 00000020:00080000:0.0:1787096607.315074:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8 cancel update log [0x200000400:0x3:0x0].8: rc = 0 00000020:00080000:0.0:1787096607.315079:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00080000:1.0:1787096607.315109:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:1.0:1787096607.315122:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:2.0:1787096607.315129:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 17 rpc_version 17 00000001:00080000:1.0:1787096607.315138:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000004:00080000:1.0:1787096607.315141:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1787096607.315145:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00100000:2.0:1787096607.315165:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096607.315177:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961742c9aa00 x1873906354013952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096607.315201:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c9aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354013952:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096607.315215:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354014208:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787096607.315276:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.315286:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.315293:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.315299:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ee00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096607.315303:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.315312:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.315329:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0xc0870d27 (ffff961741932e00) 00010000:00010000:0.0:1787096607.315334:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096607.315339:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096607.315344:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354014336:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787096607.315357:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166cd93 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096607.315401:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354014080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787096607.315511:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096607.315569:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354014208 00000100:00100000:1.0:1787096607.315574:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354014208 00000100:00100000:1.0:1787096607.315616:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787096607.315622:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3634:x1873906354014208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787096607.315642:0:8362:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787096607.315703:0:8362:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 524288, mtime: 0x6a84ee19, atime: 0x6a84ee19, ctime: 0x6a84ee19, blocks: 0x400 00010000:00010000:1.0:1787096607.315708:0:8362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315718:0:8362:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096607.315720:0:8362:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096607.315723:0:8362:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315733:0:8362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315739:0:8362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315748:0:8362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315758:0:8362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787096607.315841:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3634:x1873906354014208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 219us (336us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787096607.315846:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787096607.315861:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787096607.315869:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096607.315873:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315878:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5000 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:1.0:1787096607.315880:0:10297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315884:0:10297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315892:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315897:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55cd451/0xa979d75fc166cdee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096607.315914:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096607.315916:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096607.315917:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787096607.315943:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96186dfb8380/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787096607.315950:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354014208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787096607.316309:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096607.316322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096607.316334:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961850896780 going to sleep for 11 seconds 00000100:00100000:3.0:1787096607.316358:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354014336 00000100:00100000:3.0:1787096607.316371:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354014336 00000100:00080000:2.0:1787096607.316398:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096607.316405:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787096607.316412:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906354014336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787096607.316422:0:10250:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1787096607.316433:0:10250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.316474:0:10250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4c0d090/0xa979d75fc166cc6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23a5 expref: 5 pid: 8362 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.316479:0:10250:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096607.316480:0:10250:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096607.316482:0:10250:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.316500:0:10250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4c0d090/0xa979d75fc166cc6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23a5 expref: 5 pid: 8362 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.316509:0:10250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4c0d090/0xa979d75fc166cc6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23a5 expref: 5 pid: 8362 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096607.316519:0:10250:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10250:1873906354014464:192.168.201.40@tcp:104: 00000001:00080000:2.0:1787096607.316567:0:8358:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:3.0:1787096607.316568:0:10250:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14240 going to sleep for 11 seconds 00000001:00080000:2.0:1787096607.316580:0:8358:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:1.0:1787096607.318520:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354013952 00000100:00100000:1.0:1787096607.318526:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354013952 00000100:00100000:1.0:1787096607.318559:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787096607.318565:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8450:x1873906354013952:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096607.318630:0:10250:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10250:1873906354014464:192.168.201.40@tcp:104: 00010000:00010000:3.0:1787096607.318661:0:10250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096607.318675:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8450:x1873906354013952:12345-0@lo:1000:osp_up1-0.0 Request processed in 109us (2365us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1787096607.318681:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787096607.318715:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c9aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354013952:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787096607.318722:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 18 rpc_version 18 00000020:00100000:1.0:1787096607.318735:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096607.318740:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96186dfbbb80 x1873906354014720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096607.318752:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfbbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354014720:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096607.318775:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096607.318796:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961743457600 going to sleep for 11 seconds 00000100:00100000:2.0:1787096607.318818:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354014720 00000100:00100000:2.0:1787096607.318823:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354014720 00000100:00100000:2.0:1787096607.318858:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787096607.318866:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8450:x1873906354014720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096607.318959:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096607.318965:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8450:x1873906354014720:12345-0@lo:1000:osp_up1-0.0 Request processed in 99us (187us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787096607.318973:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787096607.318993:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554560 00000100:00100000:3.0:1787096607.318997:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554560 00010000:00010000:3.0:1787096607.319025:0:7412:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c0d090/0xa979d75fc166cc6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23a5 expref: 6 pid: 8362 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787096607.319025:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096607.319070:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 106 00000100:00100000:3.0:1787096607.319086:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+6:2400:x1873906345554560:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096607.319097:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096607.319103:0:7412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4c0d090/0xa979d75fc166cc6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23a5 expref: 6 pid: 8362 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319114:0:7412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4c0d090/0xa979d75fc166cc6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23a5 expref: 6 pid: 8362 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319131:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c0d090/0xa979d75fc166cc6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b23a5 expref: 6 pid: 8362 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319143:0:7412:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096607.319145:0:7412:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096607.319149:0:7412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319157:0:7412:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319178:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096607.319697:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345554560:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 620us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096607.319703:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 106 00010000:00010000:3.0:1787096607.319725:0:10250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319736:0:10250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319743:0:10250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319748:0:10250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.319759:0:10250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787096607.320150:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3636:x1873906354014336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3737us (3827us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787096607.320152:0:3636:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787096607.320159:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961848f6aa00, transno 4294967305 00000100:00100000:3.0:1787096607.320164:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:2.0:1787096607.320173:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961848f69880, transno 4294967306 00000004:00080000:2.0:1787096607.320178:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961848f6b800, transno 4294967307 00000100:00100000:2.0:1787096607.320185:0:3636:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff961742cc9880 x1873906354014336/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096623 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787096607.320194:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961742cc9880/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787096607.320199:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354014336:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787096607.320282:0:6476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096607.320288:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.320297:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030000 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:3.0:1787096607.320301:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.320309:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.320322:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.320336:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a8ad75/0xa979d75fc166cdf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.320352:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096607.320354:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096607.320355:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787096607.320607:0:9999:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 3 done 00000100:00100000:0.0:1787096607.322552:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfbbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354014720:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787096607.322567:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 19 rpc_version 19 00000020:00100000:0.0:1787096607.322591:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096607.322597:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961742db2680 x1873906354014976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096607.322617:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354014976:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096607.322666:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096607.322708:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742c43300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096607.322714:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354014976 00000100:00100000:2.0:1787096607.322722:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354014976 00000100:00100000:2.0:1787096607.322767:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787096607.322777:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8450:x1873906354014976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096607.322798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096607.322904:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8450:x1873906354014976:12345-0@lo:1000:osp_up1-0.0 Request processed in 128us (237us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1787096607.322910:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787096607.322945:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354014976:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096607.322989:0:8456:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354014080 00000100:00100000:3.0:1787096607.322995:0:8456:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354014080 00000100:00100000:3.0:1787096607.323035:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787096607.323042:0:8456:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1873906354014080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787096607.323063:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1787096607.323104:0:8456:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 3145728, mtime: 0x6a84ee19, atime: 0x0, ctime: 0x6a84ee19, blocks: 0x800 00010000:00010000:3.0:1787096607.323112:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.323128:0:8456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096607.323130:0:8456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096607.323135:0:8456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.323147:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.323157:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.323180:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096607.323219:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787096607.323329:0:8456:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3635:x1873906354014080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 287us (531us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787096607.323336:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1787096607.323390:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961743415f80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787096607.323394:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354014080:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787096607.323482:0:6477:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096607.323488:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.323496:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840031c00 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:0.0:1787096607.323500:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.323509:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.323523:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.323537:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088dac2ea/0xa979d75fc166cdfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096607.323555:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096607.323557:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096607.323559:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096607.610686:0:24187:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 19:43:26 (1787096606) 00000100:00100000:0.0:1787096607.822728:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096607.822749:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906354015232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096607.822813:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096607.822818:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787096607.822828:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354015104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787096607.822851:0:8453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354015232 00000100:00100000:3.0:1787096607.822860:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096607.822860:0:8453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354015232 00000100:00100000:3.0:1787096607.822899:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354015104 00000100:00100000:3.0:1787096607.822903:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354015104 00000100:00080000:0.0:1787096607.822914:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096607.822932:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787096607.822936:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787096607.822945:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906354015232:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096607.822947:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3636:x1873906354015104:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:2.0:1787096607.822981:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787096607.822982:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:3.0:1787096607.823034:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3636:x1873906354015104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096607.823043:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787096607.823044:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906354015232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096607.823065:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906354015232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096607.823074:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787096607.823080:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354015104:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1787096607.823084:0:8455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290272642060ns, next at 291272639760ns, rc = 0 00000100:00100000:0.0:1787096607.823090:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354015360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096607.823116:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096607.823145:0:17665:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354015360 00000100:00100000:3.0:1787096607.823149:0:17665:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354015360 00000100:00100000:3.0:1787096607.823176:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787096607.823182:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1873906354015360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096607.823189:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096607.823216:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1873906354015360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096607.823229:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787096607.823244:0:3635:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787096607.823249:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961742ccaa00, transno 4294967303 00000004:00080000:0.0:1787096607.823261:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961742cc8e00, transno 4294967305 00000004:00080000:0.0:1787096607.823264:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961742db0700, transno 4294967306 00000004:00080000:0.0:1787096607.823266:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961742db2300, transno 4294967307 00000100:00100000:0.0:1787096607.823281:0:3635:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff96186dfb8380 x1873906354014208/t4294967308(4294967308) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096623 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096607.823294:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354015360:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787096607.823810:0:8454:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 1 in progress, 0 in flight, 4 done 00010000:00010000:2.0:1787096608.014677:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096608.344622:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096608.344643:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096608.344708:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096608.344712:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096608.344739:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96187c92fc00/0xa979d75fc166cdb6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166cdbd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787096608.344756:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967361 is committed 00000001:00080000:0.0:1787096608.344766:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967358 is committed 00000020:00080000:0.0:1787096608.344775:0:7400:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 9 batchid updated 00000100:00100000:1.0:1787096608.344907:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787096608.344932:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354015488:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1787096608.344994:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096608.345036:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354015488 00000100:00100000:0.0:1787096608.345043:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354015488 00000020:00080000:1.0:1787096608.345049:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00000100:00100000:0.0:1787096608.345087:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787096608.345096:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3637:x1873906354015488:12345-0@lo:103:jbd2/dm-1-8.0 00000004:00080000:1.0:1787096608.345098:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961743457f00 with version 23 00000020:00080000:1.0:1787096608.345112:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 9 cancel update log [0x200000401:0x3:0x0].9: rc = 0 00010000:00010000:0.0:1787096608.345112:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096608.345132:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96187c92ea00/0xa979d75fc166cdbd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166cdb6 expref: 7 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096608.345201:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 9 cancel update log [0x240000400:0x3:0x0].9: rc = 0 00000020:00080000:1.0:1787096608.345208:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00000004:00080000:1.0:1787096608.345216:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 23 rpc_version 23 00000020:00100000:1.0:1787096608.345244:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096608.345251:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96186dfbb480 x1873906354015744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096608.345265:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfbb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354015744:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096608.345292:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096608.345305:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961743457cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787096608.345315:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffff961742a25c00) 00000100:00100000:1.0:1787096608.345320:0:23023:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354015744 00000100:00100000:1.0:1787096608.345324:0:23023:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354015744 00010000:00010000:0.0:1787096608.345328:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096608.345353:0:23023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787096608.345360:0:23023:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906354015744:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096608.345375:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3637:x1873906354015488:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 280us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096608.345381:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787096608.345521:0:23023:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906354015744:12345-0@lo:1000:osp_up0-1.0 Request processed in 160us (227us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787096608.345528:0:23023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787096608.345539:0:7416:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967434 gen 2 00000004:00080000:0.0:1787096608.345545:0:7416:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967430 committed transno 4294967434 00000004:00080000:0.0:1787096608.345568:0:7416:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967431 committed transno 4294967434 00000004:00080000:0.0:1787096608.345578:0:7416:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967433 committed transno 4294967434 00000020:00080000:0.0:1787096608.345588:0:7416:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff961742d74f00 refcount 2 committed 0 result 0 batchid 10 00000020:00080000:0.0:1787096608.345592:0:7416:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96174340a700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff961742d74000 00000020:00080000:0.0:1787096608.345595:0:7416:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].10 00000020:00080000:0.0:1787096608.345597:0:7416:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961741e1ee00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742f7a200 00000020:00080000:0.0:1787096608.345600:0:7416:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].10 00000004:00080000:0.0:1787096608.345683:0:7416:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967434 committed transno 4294967434 00000020:00080000:0.0:1787096608.345687:0:7416:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff961742d74540 refcount 2 committed 0 result 0 batchid 11 00000020:00080000:0.0:1787096608.345690:0:7416:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96174340ae00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff961742d74600 00000020:00080000:0.0:1787096608.345692:0:7416:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].11 00000020:00080000:0.0:1787096608.345694:0:7416:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96174340a500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742c54600 00000020:00080000:0.0:1787096608.345697:0:7416:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].11 00000100:00100000:0.0:1787096608.345708:0:7416:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff96186dfbb480 x1873906354015744/t4294967435(4294967435) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787096624 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096608.345724:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfbb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354015744:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1787096608.345796:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 11 committed batchid 9 00000020:00080000:3.0:1787096608.345827:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00000100:00100000:1.0:1787096608.347530:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354015488:0@lo:103:jbd2/dm-1-8.0 00000001:02000400:3.0:1787096608.424420:0:24235:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27d needs >= 8 OSTs 00010000:00010000:1.0:1787096609.038625:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096609.316398:0:24283:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 19:43:28 (1787096608) 00000001:02000400:0.0:1787096610.048624:0:24331:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27e needs >= 8 OSTs 00010000:00010000:3.0:1787096610.064367:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096610.081792:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096610.082256:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554688 00000100:00100000:1.0:1787096610.082275:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554688 00000100:00100000:1.0:1787096610.082420:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 336 00000100:00100000:1.0:1787096610.082431:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345554688:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096610.082514:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345554688:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 85us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096610.082521:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 336 00000100:00100000:3.0:1787096610.082764:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096610.082837:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554816 00000100:00100000:3.0:1787096610.082841:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554816 00000100:00100000:3.0:1787096610.082969:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 320 00000100:00100000:3.0:1787096610.082978:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345554816:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096610.083015:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345554816:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.083022:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 320 00000100:00080000:3.0:1787096610.083040:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096610.083068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096610.083104:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096610.083124:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096610.083141:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345555072 00000100:00100000:3.0:1787096610.083145:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345555072 00000100:00100000:3.0:1787096610.083172:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345555200 00000100:00100000:3.0:1787096610.083176:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345555200 00000100:00100000:3.0:1787096610.083196:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 143 00000100:00100000:3.0:1787096610.083202:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345555072:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096610.083232:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345555072:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 30us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.083238:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 143 00000100:00100000:3.0:1787096610.083257:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 144 00000100:00100000:3.0:1787096610.083262:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345555200:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096610.083285:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345555200:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 23us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.083290:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 144 00000100:00100000:3.0:1787096610.083305:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345554944 00000100:00100000:3.0:1787096610.083308:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345554944 00000100:00100000:3.0:1787096610.083334:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 321 00000100:00100000:3.0:1787096610.083341:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345554944:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096610.083363:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345554944:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.083369:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 321 00000100:00080000:3.0:1787096610.083393:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096610.083411:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096610.083414:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096610.382660:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef59912-d6a3-4393-bae9-348c8f3519b6:3637:1873906354016000:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.382671:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354015872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096610.382742:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354016256:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.382759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096610.382771:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.382791:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906354016128:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.382830:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1873906354016512:0@lo:400:kworker.0 00000100:00100000:2.0:1787096610.382831:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906354016384:0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.382840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.382844:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.382877:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906354016640:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.382883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096610.382885:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354016768:0@lo:400:kworker.0 00000100:00100000:2.0:1787096610.382900:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354015872 00000100:00100000:3.0:1787096610.382918:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354017024:0@lo:400:kworker.0 00000100:00100000:0.0:1787096610.382925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096610.382930:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096610.382948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.382955:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906354017152:0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.382960:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1873906354017280:0@lo:400:kworker.0 00000100:00100000:0.0:1787096610.382985:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.383010:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354017664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096610.383011:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.383045:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096610.383053:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016000 00000100:00100000:1.0:1787096610.383061:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016000 00000100:00100000:0.0:1787096610.383082:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016128 00000100:00100000:0.0:1787096610.383099:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016128 00000100:00100000:1.0:1787096610.383124:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787096610.383125:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016512 00000100:00100000:0.0:1787096610.383129:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016512 00000100:00100000:3.0:1787096610.383137:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354017536:0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.383138:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3637:x1873906354016000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096610.383154:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016640 00000100:00100000:0.0:1787096610.383158:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016640 00000100:00100000:0.0:1787096610.383173:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017152 00000100:00100000:3.0:1787096610.383174:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.383178:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017152 00000100:00100000:2.0:1787096610.383187:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354015872 00000100:00100000:0.0:1787096610.383198:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017280 00000100:00100000:0.0:1787096610.383203:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017280 00000100:00100000:1.0:1787096610.383204:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3637:x1873906354016000:12345-0@lo:400:kworker.0 Request processed in 69us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096610.383215:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787096610.383224:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787096610.383235:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906354016128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096610.383235:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017664 00000100:00100000:0.0:1787096610.383241:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787096610.383250:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017664 00000100:00100000:1.0:1787096610.383254:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016256 00000100:00100000:0.0:1787096610.383254:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1873906354016512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.383260:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016256 00000100:00100000:3.0:1787096610.383707:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906354016128:12345-0@lo:400:kworker.0 Request processed in 64us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.383715:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787096610.383731:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787096610.383737:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906354016640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.383766:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906354016640:12345-0@lo:400:kworker.0 Request processed in 30us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.383777:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787096610.383789:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787096610.383794:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906354017152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.383820:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906354017152:12345-0@lo:400:kworker.0 Request processed in 25us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.383825:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787096610.383835:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787096610.383840:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1873906354017280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.383868:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1873906354017280:12345-0@lo:400:kworker.0 Request processed in 29us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.383873:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787096610.383892:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016768 00000100:00100000:3.0:1787096610.383895:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016768 00000100:00100000:3.0:1787096610.383916:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017024 00000100:00100000:3.0:1787096610.383919:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017024 00000100:00100000:3.0:1787096610.383932:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017536 00000100:00100000:3.0:1787096610.383934:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017536 00000100:00100000:3.0:1787096610.383945:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787096610.383950:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906354016768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.383989:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906354016768:12345-0@lo:400:kworker.0 Request processed in 38us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.383995:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787096610.384009:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787096610.384014:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1873906354017024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384036:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1873906354017024:12345-0@lo:400:kworker.0 Request processed in 23us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.384042:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787096610.384052:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787096610.384057:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3634:x1873906354017536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384082:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3634:x1873906354017536:12345-0@lo:400:kworker.0 Request processed in 25us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.384088:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1787096610.384107:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787096610.384110:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096610.384112:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096610.384114:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096610.384213:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787096610.384223:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3636:x1873906354016256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.384263:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3636:x1873906354016256:12345-0@lo:400:kworker.0 Request processed in 42us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096610.384755:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787096610.384784:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906354016128:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384794:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906354016640:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384802:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906354017152:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384833:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354016256:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384840:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354016768:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384846:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1873906354017280:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384876:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1873906354016512:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384882:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354017024:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.384888:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354017536:0@lo:400:kworker.0 00000100:00100000:2.0:1787096610.386024:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787096610.386048:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906354015872:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096610.386052:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787096610.386066:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1873906354017664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787096610.386083:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787096610.386084:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096610.386436:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354015872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096610.388205:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1873906354016512:12345-0@lo:400:kworker.0 Request processed in 57us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096610.388339:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787096610.388388:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1873906354017664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2324us (5340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096610.388406:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787096610.388533:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906354015872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2492us (5776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096610.388540:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787096610.388631:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906354017664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096610.395538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096610.395672:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906354016896:0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.395732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096610.395755:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354017408:0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.395778:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096610.395818:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef59912-d6a3-4393-bae9-348c8f3519b6:3637:1873906354016000:0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.395858:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017408 00000100:00100000:1.0:1787096610.395864:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017408 00000100:00100000:1.0:1787096610.395904:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787096610.395913:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906354017408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096610.395964:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906354017408:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096610.395971:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787096610.396004:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906354017408:0@lo:400:kworker.0 00000100:00100000:0.0:1787096610.396309:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016896 00000100:00100000:0.0:1787096610.396314:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016896 00000100:00100000:0.0:1787096610.396349:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787096610.396357:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906354016896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096610.396419:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906354016896:12345-0@lo:400:kworker.0 Request processed in 63us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096610.396427:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787096610.396473:0:3637:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:0.0:1787096610.396478:0:3637:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967359 committed transno 4294967361 00000004:00080000:0.0:1787096610.396494:0:3637:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967360 committed transno 4294967361 00000004:00080000:0.0:1787096610.396502:0:3637:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967361 committed transno 4294967361 00000100:00100000:0.0:1787096610.396511:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906354016896:0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.397615:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354016384 00000100:00100000:3.0:1787096610.397623:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354016384 00000100:00100000:3.0:1787096610.397657:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787096610.397663:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906354016384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096610.397765:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906354016384:12345-0@lo:400:kworker.0 Request processed in 101us (9324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096610.397772:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787096610.397828:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906354016384:0@lo:400:kworker.0 00000100:00100000:2.0:1787096610.896796:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354017792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787096610.896863:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096610.897105:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017792 00000100:00100000:0.0:1787096610.897118:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017792 00000100:00100000:0.0:1787096610.897171:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787096610.897180:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3636:x1873906354017792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787096610.897211:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:0.0:1787096610.897306:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3636:x1873906354017792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096610.897313:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787096610.897368:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906354017792:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787096611.085580:0:24379:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 19:43:29 (1787096609) 00010000:00010000:0.0:1787096611.090586:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096611.972250:0:24427:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27f needs >= 8 OSTs 00010000:00010000:2.0:1787096612.110641:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096612.879998:0:24475:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 19:43:31 (1787096611) 00000100:00100000:2.0:1787096612.944086:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906354017920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787096612.944149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096612.944265:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354017920 00000100:00100000:2.0:1787096612.944272:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354017920 00000100:00100000:2.0:1787096612.944334:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787096612.944346:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906354017920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096612.944390:0:7418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:2.0:1787096612.944510:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906354017920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096612.944518:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787096612.944563:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906354017920:0@lo:41:osp-pre-1-0.0 00000004:00080000:0.0:1787096612.944842:0:8455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295394400068ns, next at 296394396858ns, rc = 0 00000100:00100000:0.0:1787096612.944893:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096612.944932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096612.944973:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787096612.944982:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354018176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096612.945013:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096612.945078:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354018048 00000100:00100000:3.0:1787096612.945084:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354018048 00000100:00100000:3.0:1787096612.945133:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354018176 00000100:00100000:3.0:1787096612.945137:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354018176 00000100:00100000:3.0:1787096612.945166:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787096612.945176:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1873906354018048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096612.945198:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096612.945244:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1873906354018048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096612.945250:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787096612.945268:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787096612.945277:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906354018176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787096612.945288:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096612.945332:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906354018176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096612.945339:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1787096612.945373:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096612.945478:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906354018176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096612.945513:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906354018048:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787096612.949029:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1787096612.949052:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000004:00080000:3.0:1787096612.949060:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1787096612.949255:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354018304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787096612.949341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096612.949426:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354018304 00000100:00100000:3.0:1787096612.949433:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354018304 00000100:00100000:3.0:1787096612.949567:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787096612.949578:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3636:x1873906354018304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787096612.949603:0:10250:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1787096612.949848:0:10250:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787096612.949857:0:10250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.949873:0:10250:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096612.949876:0:10250:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096612.949881:0:10250:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.949897:0:10250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.949908:0:10250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.949916:0:10250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.949943:0:10250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096612.949952:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096612.949959:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096612.949969:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030000 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:2.0:1787096612.949972:0:10297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096612.949982:0:10297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096612.949998:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096612.950006:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a8ad75/0xa979d75fc166ce03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096612.950036:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096612.950038:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096612.950040:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096612.950095:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3636:x1873906354018304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 517us (752us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787096612.950104:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:3.0:1787096612.950153:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961742e62300/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787096612.950159:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354018304:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787096612.952339:0:8358:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787096612.962725:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096612.963016:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345555328 00000100:00100000:3.0:1787096612.963027:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345555328 00000100:00100000:3.0:1787096612.963657:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 353 00000100:00100000:3.0:1787096612.963669:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:40689:x1873906345555328:12345-192.168.201.40@tcp:41:stat.0 00000004:00000024:3.0:1787096612.963719:0:6488:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787096612.963790:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:40689:x1873906345555328:12345-192.168.201.40@tcp:41:stat.0 Request processed in 124us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096612.963797:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 353 00000100:00080000:0.0:1787096612.964002:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096612.984888:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096612.984987:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345555456 00000100:00100000:0.0:1787096612.984998:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345555456 00000100:00100000:0.0:1787096612.985180:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 354 00000100:00100000:0.0:1787096612.985305:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+5:40693:x1873906345555456:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096612.985327:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096612.985392:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2407 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.985957:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166ce11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.985972:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166ce11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.985984:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166ce11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096612.986028:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096612.986032:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096612.986114:0:9989:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166ce11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.986139:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2407 expref: 7 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.986165:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166ce11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2407 expref: 6 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.986173:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096612.986176:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096612.986179:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e200, rc 0) 00000100:00100000:0.0:1787096612.986389:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+6:40693:x1873906345555456:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1088us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096612.986397:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 354 00000100:00100000:1.0:1787096612.988404:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096612.988804:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345555584 00000100:00100000:0.0:1787096612.988813:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345555584 00000100:00100000:0.0:1787096612.988962:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 355 00000100:00100000:0.0:1787096612.988972:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+6:40693:x1873906345555584:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096612.988990:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096612.989004:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166ce18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b240e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989054:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989067:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989077:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989091:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989097:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989104:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989139:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989147:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989153:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989169:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989175:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096612.989179:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989198:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989210:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096612.989213:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096612.989218:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989224:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989236:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989242:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989247:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989252:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fe00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096612.989254:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989274:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989282:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff961741933700) 00010000:00010000:0.0:1787096612.989284:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096612.989287:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989293:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989319:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166ce18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b240e expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989329:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096612.989331:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096612.989334:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166ce18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b240e expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096612.989342:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e600, rc 0) 00000100:00100000:0.0:1787096612.989407:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+6:40693:x1873906345555584:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 437us (1005us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096612.989414:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 355 00000100:00100000:1.0:1787096612.993492:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096612.993588:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345555840 00000100:00100000:3.0:1787096612.993597:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345555840 00000100:00100000:3.0:1787096612.993650:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 356 00000100:00100000:3.0:1787096612.993661:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+6:40693:x1873906345555840:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1787096612.993714:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096612.993737:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e200/0xa979d75fc166ce11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2407 expref: 6 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.993756:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:3.0:1787096612.993767:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096612.993822:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.993835:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.993845:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.993860:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166ce34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.993867:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166ce34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.993874:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166ce34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787096612.995735:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].9, 2152 off47272 00000040:00080000:3.0:1787096612.995795:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].9, 2352 off48592 00000004:00080000:3.0:1787096612.995802:0:6488:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961742d74840 with version 20 00000004:00080000:0.0:1787096612.995836:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 20 rpc_version 20 00000020:00100000:0.0:1787096612.995870:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096612.995880:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96187c9e6680 x1873906354018560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096612.995948:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354018560:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096612.996006:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096612.996055:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741e933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096612.996223:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354018560 00000100:00100000:1.0:1787096612.996229:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354018560 00000100:00100000:1.0:1787096612.996271:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787096612.996280:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8450:x1873906354018560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096612.996665:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8450:x1873906354018560:12345-0@lo:1000:osp_up1-0.0 Request processed in 386us (657us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787096612.996673:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787096612.996789:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354018560:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787096612.996881:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166ce3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996894:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166ce3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996905:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166ce3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996923:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166ce42 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996941:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166ce42 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996948:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166ce42 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996968:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996973:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.996980:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096612.996989:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742e63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6488:1873906354018688:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787096612.997009:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096612.997040:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d74000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096612.997063:0:23023:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354018688 00000100:00100000:1.0:1787096612.997067:0:23023:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354018688 00000100:00100000:1.0:1787096612.997096:0:23023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787096612.997103:0:23023:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6488:x1873906354018688:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096612.997116:0:23023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096612.997144:0:23023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166ce50 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166ce49 expref: -99 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096612.997163:0:23023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166ce50 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166ce49 expref: 7 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096612.997175:0:23023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166ce50 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166ce49 expref: 7 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096612.997193:0:23023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff9618472ca000) 00010000:00010000:1.0:1787096612.997196:0:23023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096612.997200:0:23023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4e00, rc 0) 00000100:00100000:1.0:1787096612.997231:0:23023:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6488:x1873906354018688:12345-0@lo:101:mdt00_000.0 Request processed in 129us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096612.997237:0:23023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787096612.997241:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742e63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6488:1873906354018688:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787096612.997252:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997261:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096612.997282:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c2f5f4df reply state 00000000f2e0cbca transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166ce42 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997293:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166ce42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997306:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff961862853500) 00010000:00010000:3.0:1787096612.997308:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096612.997311:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096612.997317:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997325:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096612.997334:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000004:00010000:3.0:1787096612.997339:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c2f5f4df reply state 00000000f2e0cbca transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166ce3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997359:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166ce3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997365:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff961862853900) 00010000:00010000:3.0:1787096612.997366:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096612.997368:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787096612.997373:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:3.0:1787096612.997378:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997382:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997386:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997390:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997404:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840031000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096612.997408:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997415:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997425:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:3.0:1787096612.997427:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096612.997431:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997437:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce2d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096612.997478:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c2f5f4df reply state 00000000f2e0cbca transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166ce34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997487:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166ce34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096612.997493:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff961862853e00) 00010000:00010000:3.0:1787096612.997496:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096612.997498:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787096612.997562:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+7:40693:x1873906345555840:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 3902us (4078us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787096612.997568:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 356 00000100:00100000:2.0:1787096613.010902:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096613.011086:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345555968 00000100:00100000:0.0:1787096613.011096:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345555968 00000100:00100000:0.0:1787096613.011154:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 357 00000100:00100000:0.0:1787096613.011164:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+7:40696:x1873906345555968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096613.011187:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096613.011205:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166ce57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2415 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.011270:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.011285:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.011295:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096613.011332:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096613.011336:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096613.011364:0:9989:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.011386:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166ce57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2415 expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.011402:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166ce5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2415 expref: 8 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.011423:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096613.011426:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096613.011430:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340fe00, rc 0) 00000100:00100000:0.0:1787096613.011545:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+8:40696:x1873906345555968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 382us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096613.011552:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 357 00000100:00100000:1.0:1787096613.015373:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096613.015501:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345556096 00000100:00100000:0.0:1787096613.015512:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345556096 00000100:00100000:0.0:1787096613.015569:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 358 00000100:00100000:0.0:1787096613.015581:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+8:40696:x1873906345556096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096613.015599:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096613.015617:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b241c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015676:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015691:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015702:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015714:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015722:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015744:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015816:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166ce7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015825:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166ce7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015832:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166ce7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096613.015903:0:6490:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000004:00200000:0.0:1787096613.015908:0:6490:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787096613.015927:0:6490:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166ce7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015939:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015945:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015951:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015957:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015963:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096613.015967:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015980:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.015991:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096613.015994:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096613.015998:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016004:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166ce6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016015:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016020:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016026:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016031:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ee00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096613.016034:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016039:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016046:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff961862853e00) 00010000:00010000:0.0:1787096613.016049:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096613.016051:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016066:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ce73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016091:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ce65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b241c expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016103:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166ce7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b241c expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.016110:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff961862853900) 00010000:00010000:0.0:1787096613.016112:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787096613.016114:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340fa00, rc 0) 00000100:00100000:0.0:1787096613.016173:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+9:40696:x1873906345556096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 594us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096613.016179:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 358 00000100:00100000:2.0:1787096613.017526:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096613.017586:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345556224 00000100:00100000:3.0:1787096613.017599:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345556224 00000100:00100000:3.0:1787096613.017674:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 359 00000100:00100000:3.0:1787096613.017700:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+9:40696:x1873906345556224:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1787096613.017725:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096613.017745:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce81 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2423 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.017826:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166ce88 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.017841:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166ce88 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.017853:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166ce88 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096613.017921:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787096613.017926:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096613.017963:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce81 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2423 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.017994:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166ce88 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2423 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.018003:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff961862853500) 00010000:00010000:3.0:1787096613.018007:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096613.018010:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030e00, rc 0) 00000100:00100000:3.0:1787096613.018093:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+10:40696:x1873906345556224:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 395us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096613.018101:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 359 00000100:00100000:2.0:1787096613.019793:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096613.019872:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345556352 00000100:00100000:1.0:1787096613.019885:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345556352 00000100:00080000:3.0:1787096613.019946:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096613.019961:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 360 00000100:00100000:1.0:1787096613.019978:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:40696:x1873906345556352:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096613.019997:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096613.020013:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5400/0xa979d75fc166ce8f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b242a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.020072:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.020089:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166ce50 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166ce49 expref: 6 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.020096:0:6489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.020125:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166ce50 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa979d75fc166ce49 expref: 6 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096613.020137:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bbbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6489:1873906354018816:0@lo:104: 00000100:00100000:1.0:1787096613.020195:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096613.020255:0:6489:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741d70780 going to sleep for 11 seconds 00000100:00100000:0.0:1787096613.020309:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354018816 00000100:00100000:0.0:1787096613.020313:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354018816 00000100:00100000:0.0:1787096613.020357:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787096613.020364:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6489:x1873906354018816:12345-0@lo:104: 00010000:00010000:0.0:1787096613.020375:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.020456:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787096613.020464:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6489:x1873906354018816:12345-0@lo:104: Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096613.020473:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:2.0:1787096613.020491:0:6476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787096613.020491:0:6489:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bbbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6489:1873906354018816:0@lo:104: 00010000:00010000:2.0:1787096613.020506:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.020517:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096613.020519:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840031c00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:2.0:1787096613.020529:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096613.020548:0:6476:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096613.020589:0:6476:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096613.020596:0:6476:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096613.020631:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096613.020637:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840031c00/0xa979d75fc166ce49 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166ce50 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096613.020662:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787096613.020665:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096613.020676:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096613.020680:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354018944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096613.020681:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096613.020719:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096613.020794:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354018944 00000100:00100000:1.0:1787096613.020797:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354018944 00010000:00010000:1.0:1787096613.020823:0:6474:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166ce50 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa979d75fc166ce49 expref: 7 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096613.020848:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787096613.020853:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618589c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3636:x1873906354018944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096613.020860:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787096613.022261:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967362 is committed 00000020:00080000:0.0:1787096613.022275:0:7400:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 11 batchid updated 00010000:00010000:1.0:1787096613.022357:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166ce50 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa979d75fc166ce49 expref: 6 pid: 23023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.022373:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff9618472ca000) 00010000:00010000:1.0:1787096613.022378:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.022387:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.022394:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.022419:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096613.022484:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096613.022495:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096613.022498:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618589c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906354018944:12345-0@lo:103:ldlm_bl.0 Request processed in 1642us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096613.022514:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787096613.022531:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906354018944:0@lo:103:ldlm_bl.0 00000004:00200000:2.0:1787096613.022554:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1787096613.022559:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096613.022601:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5400/0xa979d75fc166ce8f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b242a expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096613.022603:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00010000:00010000:2.0:1787096613.022620:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166ce96 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b242a expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096613.022629:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff9618472ca000) 00010000:00010000:2.0:1787096613.022632:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096613.022635:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4000, rc 0) 00000004:00080000:3.0:1787096613.022657:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961742d74000 with version 24 00000020:00080000:3.0:1787096613.022671:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 10 cancel update log [0x200000401:0x3:0x0].10: rc = 0 00000100:00100000:2.0:1787096613.022682:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+6:40696:x1873906345556352:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2708us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096613.022687:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 360 00000004:00080000:0.0:1787096613.022721:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 24 rpc_version 24 00000020:00080000:3.0:1787096613.022735:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 10 cancel update log [0x240000400:0x3:0x0].10: rc = 0 00000020:00100000:0.0:1787096613.022743:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096613.022751:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96186dfb8e00 x1873906354019200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:3.0:1787096613.022756:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961741c07b40 with version 25 00000020:00080000:3.0:1787096613.022759:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 11 cancel update log [0x200000401:0x3:0x0].11: rc = 0 00000100:00100000:0.0:1787096613.022768:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354019200:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1787096613.022776:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 11 cancel update log [0x240000400:0x3:0x0].11: rc = 0 00000020:00080000:3.0:1787096613.022781:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00000100:00100000:0.0:1787096613.022803:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096613.022827:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741e930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096613.022844:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354019200 00000100:00100000:3.0:1787096613.022849:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354019200 00000100:00100000:3.0:1787096613.022888:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787096613.022896:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7416:x1873906354019200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096613.023088:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906354019200:12345-0@lo:1000:osp_up0-1.0 Request processed in 193us (284us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787096613.023096:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787096613.023123:0:7416:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967435 gen 2 00000004:00080000:0.0:1787096613.023128:0:7416:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967435 committed transno 4294967435 00000100:00100000:0.0:1787096613.023142:0:7416:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff96186dfb8e00 x1873906354019200/t4294967437(4294967437) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787096629 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096613.023156:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354019200:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787096613.023164:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 25 rpc_version 25 00000020:00100000:0.0:1787096613.023175:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096613.023180:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96186dfbb480 x1873906354019456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096613.023192:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfbb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354019456:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096613.023217:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096613.023241:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741e930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096613.023290:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354019456 00000100:00100000:2.0:1787096613.023295:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354019456 00000100:00100000:2.0:1787096613.023404:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787096613.023412:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187552ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906354019456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096613.023516:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187552ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7416:x1873906354019456:12345-0@lo:1000:osp_up0-1.0 Request processed in 104us (297us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787096613.023522:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787096613.023595:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfbb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906354019456:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096613.024800:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096613.024844:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345556480 00000100:00100000:3.0:1787096613.024851:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345556480 00000100:00100000:3.0:1787096613.024893:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 361 00000100:00100000:3.0:1787096613.024902:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+10:40696:x1873906345556480:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1787096613.024916:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096613.024932:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce9d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2431 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.024993:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025014:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025025:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025132:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025141:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025148:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025206:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025213:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025219:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025226:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025233:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096613.025238:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025245:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025263:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff961862853500) 00010000:00010000:3.0:1787096613.025267:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096613.025272:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025279:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166cea4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025293:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025299:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025305:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025311:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840031c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096613.025314:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025327:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025335:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xe0be4298 (ffff961862853300) 00010000:00010000:3.0:1787096613.025337:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096613.025340:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025358:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840031c00/0xa979d75fc166ceab lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025399:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce9d lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2431 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025409:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff961862853500) 00010000:00010000:3.0:1787096613.025411:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096613.025415:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166ce9d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2431 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.025424:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840031000, rc 0) 00000100:00100000:3.0:1787096613.025576:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+10:40696:x1873906345556480:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 674us (779us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096613.025584:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 361 00000100:00100000:1.0:1787096613.030528:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096613.030670:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345556736 00000100:00100000:0.0:1787096613.030680:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345556736 00000100:00100000:0.0:1787096613.030730:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 362 00000100:00100000:0.0:1787096613.030740:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+10:40696:x1873906345556736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096613.030773:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096613.030775:0:8109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787096613.030800:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166ce88 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2423 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.030820:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff961862853500) 00010000:00010000:0.0:1787096613.030824:0:8109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096613.030837:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ceb2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2438 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.030931:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.030941:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.030951:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.030964:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166cec0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.030971:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.030977:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031322:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031341:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031362:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096613.031373:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00010000:00010000:0.0:1787096613.031397:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031404:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031410:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031416:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031422:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ee00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096613.031426:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031433:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031476:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff961862853500) 00010000:00010000:0.0:1787096613.031479:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096613.031483:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031490:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166ceb9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096613.031507:0:8109:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006acb56c3 reply state 000000003a3216f6 transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031518:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166cec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031525:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xe0be4298 (ffff961741936400) 00010000:00010000:0.0:1787096613.031526:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096613.031529:0:8109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096613.031555:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166ceb2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 12 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031568:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 11 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096613.031575:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff961741936500) 00010000:00010000:0.0:1787096613.031578:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096613.031579:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e600, rc 0) 00000100:00100000:0.0:1787096613.031647:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+12:40696:x1873906345556736:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 908us (1127us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787096613.031655:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 362 00000100:00100000:2.0:1787096613.038733:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096613.039100:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345556992 00000100:00100000:1.0:1787096613.039109:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345556992 00000100:00100000:1.0:1787096613.039172:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 363 00000100:00100000:1.0:1787096613.039181:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+12:40696:x1873906345556992:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096613.039205:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096613.039235:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166ced5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b243f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.039337:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.039364:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 13 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.039372:0:6489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.039402:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 13 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.039413:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 13 pid: 8109 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096613.039425:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bbbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6489:1873906354019584:192.168.201.40@tcp:104: 00000100:00100000:1.0:1787096613.039551:0:6489:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741d703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096613.041311:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096613.041419:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345557120 00000100:00100000:3.0:1787096613.041426:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345557120 00000100:00100000:1.0:1787096613.041579:0:6489:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bbbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6489:1873906354019584:192.168.201.40@tcp:104: 00010000:00010000:1.0:1787096613.041601:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.041670:0:7412:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 14 pid: 8109 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096613.041743:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 108 00000100:00100000:3.0:1787096613.041753:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+14:2400:x1873906345557120:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096613.041764:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096613.041769:0:7412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 14 pid: 8109 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.041780:0:7412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 14 pid: 8109 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.041811:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166cec7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2438 expref: 14 pid: 8109 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.041825:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff961741936500) 00010000:00010000:3.0:1787096613.041830:0:7412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.041837:0:7412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.041844:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096613.041869:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096613.041916:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+13:2400:x1873906345557120:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 164us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096613.041924:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 108 00010000:00010000:1.0:1787096613.042589:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042598:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096613.042629:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00010000:00010000:1.0:1787096613.042749:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042757:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042763:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042768:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096613.042772:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042779:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042787:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff961741936500) 00010000:00010000:1.0:1787096613.042790:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787096613.042793:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042799:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166cedc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042828:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166ced5 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b243f expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042837:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff961741936500) 00010000:00010000:1.0:1787096613.042839:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096613.042847:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166ced5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b243f expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096613.042860:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4e00, rc 0) 00000100:00100000:1.0:1787096613.042905:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+11:40696:x1873906345556992:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3725us (4180us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096613.042913:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 363 00000100:00100000:2.0:1787096613.045373:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096613.045921:0:13534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345557376 00000100:00100000:0.0:1787096613.045932:0:13534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345557376 00000100:00100000:0.0:1787096613.046025:0:13534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 74 00000100:00100000:0.0:1787096613.046036:0:13534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+11:40696:x1873906345557376:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1787096613.046242:0:13534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+12:40696:x1873906345557376:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 206us (874us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787096613.046264:0:13534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 74 00010000:00010000:0.0:1787096613.134677:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787096613.455939:0:9432:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:02000400:0.0:1787096613.745355:0:24523:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_28a: @@@@@@ FAIL: setstripe failed 00010000:00010000:2.0:1787096614.159674:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1847 lines, 1847 kept, 0 dropped, 0 bad.