00000100:00100000:0.0F:1715205855.477769:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1715205855.477818:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0F:1715205855.477864:0:6900:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511126464 00000100:00100000:3.0F:1715205855.477865:0:6903:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511126528 00000100:00100000:3.0:1715205855.477876:0:6903:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511126528 00000100:00100000:2.0:1715205855.477879:0:6900:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511126464 00000100:00080000:0.0:1715205855.477913:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715205825 00000100:00100000:3.0:1715205855.477916:0:6903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 134 00000100:00080000:0.0:1715205855.477917:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715205825 00000100:00100000:2.0:1715205855.477920:0:6900:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 253 00000100:00100000:3.0:1715205855.477921:0:6903:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b074247a-b4e0-48d1-8030-d4461b52d5ca+8:1964:x1798523511126528:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1715205855.477924:0:6900:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:614fb888-a54c-4440-9a2f-efd4f3a141dd+12:1965:x1798523511126464:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1715205855.477980:0:6903:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b074247a-b4e0-48d1-8030-d4461b52d5ca+8:1964:x1798523511126528:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205855.477984:0:6903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 134 00000100:00100000:2.0:1715205855.477992:0:6900:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:614fb888-a54c-4440-9a2f-efd4f3a141dd+12:1965:x1798523511126464:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205855.477999:0:6900:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 253 00010000:00010000:0.0:1715205855.997517:0:6893:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1715205856.999436:0:10076:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715205857.013444:0:3222:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715205857.013459:0:3222:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3222:1798523516383296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715205857.013501:0:3222:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205857.013536:0:8442:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383296 00000100:00100000:1.0:1715205857.013545:0:8442:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383296 00000100:00080000:0.0:1715205857.013566:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715205827 00000100:00100000:1.0:1715205857.013583:0:8442:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1715205857.013587:0:8442:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3222:x1798523516383296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715205857.013618:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1715205857.013668:0:8442:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3222:x1798523516383296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205857.013673:0:8442:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1715205857.013712:0:3222:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=62166) req@ffff88008e219f80 x1798523516383296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1715205873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 00000100:00100000:2.0:1715205857.013729:0:3222:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3222:1798523516383296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1715205858.001431:0:8454:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205858.651301:0:18673:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test 4: DoM: glimpse doesn't produce duplicated locks ========================================================== 18:04:18 (1715205858) 00000100:00100000:0.0:1715205858.674038:0:3214:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1715205858.674079:0:11667:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511126656 00000100:00100000:2.0:1715205858.674088:0:11667:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511126656 00000100:00080000:0.0:1715205858.674120:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715205828 00000100:00100000:2.0:1715205858.674141:0:11667:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:2.0:1715205858.674146:0:11667:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e21a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b074247a-b4e0-48d1-8030-d4461b52d5ca+8:4787:x1798523511126656:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715205858.674157:0:11667:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1715205858.674201:0:11667:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013200a880/0xa4db7398a345ca4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x361984fab9c06ac7 expref: 8 pid: 6904 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205858.674218:0:11667:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013200a640/0xa4db7398a345ca43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.33@tcp remote: 0x361984fab9c06ac0 expref: 7 pid: 6904 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205858.674225:0:11667:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8801349fe200) 00010000:00010000:2.0:1715205858.674235:0:11667:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132008d80/0xa4db7398a345ca19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0x361984fab9c06ab2 expref: 6 pid: 10113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205858.674246:0:11667:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8801349fe400) 00010000:00010000:2.0:1715205858.674249:0:11667:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205858.674293:0:11667:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e21a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b074247a-b4e0-48d1-8030-d4461b52d5ca+5:4787:x1798523511126656:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 146us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205858.674298:0:11667:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:0.0:1715205858.695773:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1715205858.695857:0:6903:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511126784 00000100:00100000:3.0:1715205858.695867:0:6903:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511126784 00000100:00100000:3.0:1715205858.695921:0:6903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:3.0:1715205858.695928:0:6903:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b074247a-b4e0-48d1-8030-d4461b52d5ca+5:11459:x1798523511126784:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:3.0:1715205858.695946:0:6903:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205858.695965:0:6903:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e881f80/0xa4db7398a345ca5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x361984fab9c06aff expref: -99 pid: 6903 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205858.696014:0:6903:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8821c0/0xa4db7398a345ca66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.696024:0:6903:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8821c0/0xa4db7398a345ca66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.696033:0:6903:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8821c0/0xa4db7398a345ca66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6903 initiator: MDT0 00000004:00200000:3.0:1715205858.696099:0:6903:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 11776 00000004:00200000:3.0:1715205858.696101:0:6903:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205858.696122:0:6903:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8821c0/0xa4db7398a345ca66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.696135:0:6903:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e881f80/0xa4db7398a345ca5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x361984fab9c06aff expref: 7 pid: 6903 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205858.696153:0:6903:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8821c0/0xa4db7398a345ca66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0x361984fab9c06aff expref: 6 pid: 6903 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205858.696158:0:6903:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008e31e000) 00010000:00010000:3.0:1715205858.696161:0:6903:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715205858.696162:0:6903:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e8821c0, rc 0) 00000100:00100000:3.0:1715205858.696208:0:6903:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b074247a-b4e0-48d1-8030-d4461b52d5ca+6:11459:x1798523511126784:12345-192.168.204.33@tcp:101:stat.0 Request processed in 281us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205858.696213:0:6903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 41 00000100:00100000:0.0:1715205858.697347:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1715205858.697373:0:6903:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511126848 00000100:00100000:3.0:1715205858.697376:0:6903:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511126848 00000100:00100000:3.0:1715205858.697392:0:6903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:3.0:1715205858.697395:0:6903:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b074247a-b4e0-48d1-8030-d4461b52d5ca+6:11459:x1798523511126848:12345-192.168.204.33@tcp:101:stat.0 00010000:00010000:3.0:1715205858.697400:0:6903:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205858.697405:0:6903:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882400/0xa4db7398a345ca6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x361984fab9c06b06 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205858.697423:0:6903:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697428:0:6903:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697432:0:6903:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697438:0:6903:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697447:0:6903:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697451:0:6903:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697485:0:6903:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697489:0:6903:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697492:0:6903:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697497:0:6903:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012e882640 already unused, calling callback (ffffffffa13b1730) 00010000:00010000:3.0:1715205858.697500:0:6903:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697504:0:6903:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697509:0:6903:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008e31e000) 00010000:00010000:3.0:1715205858.697510:0:6903:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205858.697512:0:6903:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697514:0:6903:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882640/0xa4db7398a345ca74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697520:0:6903:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697523:0:6903:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697528:0:6903:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697531:0:6903:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012e882880 already unused, calling callback (ffffffffa13b1730) 00010000:00010000:3.0:1715205858.697532:0:6903:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697535:0:6903:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697538:0:6903:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93b8e6e9 (ffff88008e31e800) 00010000:00010000:3.0:1715205858.697539:0:6903:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205858.697540:0:6903:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697542:0:6903:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882880/0xa4db7398a345ca7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93b8e6e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6903 initiator: MDT0 00010000:00010000:3.0:1715205858.697560:0:6903:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882400/0xa4db7398a345ca6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x361984fab9c06b06 expref: 7 pid: 6903 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205858.697564:0:6903:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e882400/0xa4db7398a345ca6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0x361984fab9c06b06 expref: 7 pid: 6903 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205858.697567:0:6903:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e882400, rc 0) 00000100:00100000:3.0:1715205858.697588:0:6903:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b074247a-b4e0-48d1-8030-d4461b52d5ca+6:11459:x1798523511126848:12345-192.168.204.33@tcp:101:stat.0 Request processed in 192us (242us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205858.697591:0:6903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00010000:00010000:1.0:1715205859.003485:0:6894:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205859.253482:0:3221:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715205859.253505:0:3224:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3224:1798523516383488:0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253505:0:3221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3221:1798523516383552:0@lo:400:kworker.0 00000100:00100000:0.0:1715205859.253519:0:3223:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3223:1798523516383424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715205859.253535:0:3222:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3222:1798523516383616:0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253563:0:3221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715205859.253564:0:3223:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715205859.253572:0:3222:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715205859.253578:0:3224:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205859.253582:0:3221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d133c499-c13b-4e41-b7dc-f1c22c13e92c:3221:1798523516383360:0@lo:400:kworker.0 00000100:00100000:0.0:1715205859.253584:0:3223:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3223:1798523516383680:0@lo:400:kworker.0 00000100:00100000:2.0:1715205859.253588:0:3224:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3224:1798523516383744:0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253599:0:3221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715205859.253600:0:13493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383616 00000100:00100000:2.0:1715205859.253601:0:3224:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715205859.253603:0:3223:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715205859.253606:0:13493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383616 00000100:00100000:1.0:1715205859.253618:0:8442:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383424 00000100:00100000:2.0:1715205859.253619:0:6900:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383360 00000100:00100000:1.0:1715205859.253620:0:8442:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383424 00000100:00100000:2.0:1715205859.253622:0:6900:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383360 00000100:00100000:0.0:1715205859.253628:0:8935:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383744 00000100:00100000:0.0:1715205859.253631:0:8935:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383744 00000100:00100000:3.0:1715205859.253637:0:13493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1715205859.253639:0:6900:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1715205859.253639:0:8442:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1715205859.253642:0:13493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3222:x1798523516383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715205859.253643:0:6900:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d133c499-c13b-4e41-b7dc-f1c22c13e92c+18:3221:x1798523516383360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253643:0:8442:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3223:x1798523516383424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715205859.253649:0:8935:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1715205859.253654:0:8935:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3224:x1798523516383744:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1715205859.253671:0:8442:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1715205859.253674:0:13493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3222:x1798523516383616:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205859.253674:0:6900:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d133c499-c13b-4e41-b7dc-f1c22c13e92c+18:3221:x1798523516383360:12345-0@lo:400:kworker.0 Request processed in 31us (73us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205859.253679:0:13493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1715205859.253679:0:6900:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1715205859.253683:0:8935:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3224:x1798523516383744:12345-0@lo:400:kworker.0 Request processed in 28us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205859.253689:0:8442:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3223:x1798523516383424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205859.253689:0:8935:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1715205859.253692:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715205829 00000100:00100000:1.0:1715205859.253693:0:8442:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1715205859.253694:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715205829 00000100:00080000:3.0:1715205859.253696:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715205829 00000100:00100000:1.0:1715205859.253706:0:6905:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383552 00000100:00100000:1.0:1715205859.253707:0:6905:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383552 00000100:00100000:0.0:1715205859.253707:0:6904:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383488 00000100:00100000:0.0:1715205859.253709:0:6904:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383488 00010000:00080000:3.0:1715205859.253710:0:3222:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=62166) req@ffff88008e24ad80 x1798523516383616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1715205875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:2.0:1715205859.253710:0:3224:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3224:1798523516383744:0@lo:400:kworker.0 00000100:00100000:3.0:1715205859.253717:0:3222:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3222:1798523516383616:0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253722:0:6905:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383680 00000100:00100000:1.0:1715205859.253723:0:6905:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383680 00000100:00100000:0.0:1715205859.253728:0:6904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1715205859.253731:0:6903:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1715205859.253732:0:6904:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3221:x1798523516383552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715205859.253734:0:6903:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3224:x1798523516383488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253736:0:6905:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1715205859.253743:0:6905:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3223:x1798523516383680:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1715205859.253745:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715205829 00000100:00100000:2.0:1715205859.253752:0:6903:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3224:x1798523516383488:12345-0@lo:400:kworker.0 Request processed in 17us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205859.253755:0:6903:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1715205859.253760:0:6904:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3221:x1798523516383552:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205859.253763:0:6905:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3223:x1798523516383680:12345-0@lo:400:kworker.0 Request processed in 20us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205859.253765:0:6904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1715205859.253766:0:3223:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3223:1798523516383424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715205859.253766:0:3224:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e24b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3224:1798523516383488:0@lo:400:kworker.0 00000100:00100000:3.0:1715205859.253772:0:3223:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3223:1798523516383680:0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253775:0:6905:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1715205859.253792:0:3221:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3221:1798523516383552:0@lo:400:kworker.0 00000100:00100000:1.0:1715205859.253796:0:3221:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d133c499-c13b-4e41-b7dc-f1c22c13e92c:3221:1798523516383360:0@lo:400:kworker.0 00010000:00010000:0.0:1715205860.005457:0:10077:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205860.486001:0:3214:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1715205860.486061:0:3214:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1715205860.486073:0:6905:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511133248 00000100:00100000:1.0:1715205860.486082:0:6905:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511133248 00000100:00100000:2.0:1715205860.486122:0:6899:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511133184 00000100:00100000:2.0:1715205860.486126:0:6899:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511133184 00000100:00100000:1.0:1715205860.486140:0:6905:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 138 00000100:00100000:1.0:1715205860.486147:0:6905:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b074247a-b4e0-48d1-8030-d4461b52d5ca+6:1964:x1798523511133248:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:3.0:1715205860.486150:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715205830 00000100:00100000:2.0:1715205860.486150:0:6899:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 255 00000100:00080000:3.0:1715205860.486155:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715205830 00000100:00100000:2.0:1715205860.486155:0:6899:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:614fb888-a54c-4440-9a2f-efd4f3a141dd+12:1965:x1798523511133184:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1715205860.486197:0:6899:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:614fb888-a54c-4440-9a2f-efd4f3a141dd+12:1965:x1798523511133184:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205860.486200:0:6905:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b074247a-b4e0-48d1-8030-d4461b52d5ca+6:1964:x1798523511133248:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 53us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205860.486204:0:6899:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 255 00000100:00100000:1.0:1715205860.486207:0:6905:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 138 00010000:00010000:0.0:1715205861.007422:0:6893:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205862.009429:0:10076:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205862.011984:0:19321:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test 5: DoM truncate deadlock ============== 18:04:21 (1715205861) 00000100:00100000:1.0:1715205862.021438:0:3221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3221:1798523516383808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715205862.021492:0:3221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715205862.021520:0:11517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516383808 00000100:00100000:2.0:1715205862.021530:0:11517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516383808 00000100:00080000:3.0:1715205862.021556:0:6901:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715205832 00000100:00100000:2.0:1715205862.021574:0:11517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1715205862.021580:0:11517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3221:x1798523516383808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715205862.021617:0:11517:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1715205862.021672:0:11517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3221:x1798523516383808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205862.021678:0:11517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1715205862.021692:0:3221:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=62166) req@ffff88008e21b800 x1798523516383808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1715205878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 00000100:00100000:0.0:1715205862.021709:0:3221:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3221:1798523516383808:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1715205862.340784:0:19385:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-dom test_5: @@@@@@ FAIL: test_5 failed with 1 Debug log: 210 lines, 210 kept, 0 dropped, 0 bad.