00010000:00010000:1.0F:1777022598.405483:0:10130:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1777022599.430379:0:5458:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777022600.455459:0:5459:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777022600.902526:0:2379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b890bd02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:e37b86fa-a637-42d0-b6d9-b01e90779c79:2379:1863342816191488:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.902618:0:2379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b890bd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2379:1863342816191744:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.902646:0:2379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b890bd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:33d9035e-b8f8-4200-afbe-3051ed275c79:2379:1863342816192000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.902669:0:2379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b890bd03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:33d9035e-b8f8-4200-afbe-3051ed275c79:2379:1863342816192256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.902697:0:2379:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777022600.902703:0:2379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b890bd03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2379:1863342816191616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.902723:0:2379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b890bd02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2379:1863342816191872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.902744:0:2379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b890bd03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:33d9035e-b8f8-4200-afbe-3051ed275c79:2379:1863342816192128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.907820:0:2379:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8b8907e85800: committing for last_committed 4294967474 gen 1 00000100:00100000:3.0:1777022600.907862:0:2379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b890bd03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2379:1863342816191616:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.907877:0:2379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b890bd02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2379:1863342816191872:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.907887:0:2379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b890bd03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:33d9035e-b8f8-4200-afbe-3051ed275c79:2379:1863342816192128:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.907898:0:2379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b890bd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2379:1863342816191744:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.907906:0:2379:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8b890a0bb800: committing for last_committed 4294967469 gen 1 00000100:00100000:3.0:1777022600.907909:0:2379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b890bd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:33d9035e-b8f8-4200-afbe-3051ed275c79:2379:1863342816192000:192.168.202.133@tcp:400:kworker.0 00000100:00100000:3.0:1777022600.907918:0:2379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b890bd03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:33d9035e-b8f8-4200-afbe-3051ed275c79:2379:1863342816192256:192.168.202.133@tcp:400:kworker.0 00000100:00100000:2.0F:1777022600.912750:0:2379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b890bd02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:e37b86fa-a637-42d0-b6d9-b01e90779c79:2379:1863342816191488:192.168.202.133@tcp:400:kworker.0 00010000:00010000:1.0:1777022601.478584:0:10194:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777022602.511515:0:10192:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777022603.446844:0:10763:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_18: @@@@@@ FAIL: 1: mmap_sanity test failed 00010000:00010000:3.0:1777022603.529602:0:10193:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777022604.492221:0:2372:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.133@tcp (source: 12345-192.168.202.133@tcp) 00000100:00100000:3.0:1777022604.495604:0:5450:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863342835953024 00000100:00100000:3.0:1777022604.495620:0:5450:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863342835953024 00000100:00100000:3.0:1777022604.495856:0:5450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.133@tcp, seq: 1525 00000100:00100000:3.0:1777022604.495867:0:5450:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff8b89099a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6923:x1863342835953024:12345-192.168.202.133@tcp:104: 00010000:00010000:3.0:1777022604.495885:0:5450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8b8907e85800 lock: 000000001fee7b9c/0x458a939de7841dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000010000 nid: local remote: 0x72ae7b78094e4ba5 expref: -99 pid: 10187 timeout: 0 lvb_type: 1 lru_score: 24 lru_type: 1 00010000:00010000:3.0:1777022604.495978:0:5450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777022604.495986:0:5450:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff8b89099a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6923:x1863342835953024:12345-192.168.202.133@tcp:104: Request processed in 121us (3776us total) trans 0 rc 0/0 00000100:00100000:3.0:1777022604.495993:0:5450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.133@tcp, seq: 1525 00010000:00010000:1.0:1777022604.496216:0:10130:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777022604.496225:0:10130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8b8907e85800 lock: 000000001fee7b9c/0x458a939de7841dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000010000 nid: local remote: 0x72ae7b78094e4ba5 expref: -99 pid: 10187 timeout: 0 lvb_type: 1 lru_score: 24 lru_type: 1 00010000:00010000:1.0:1777022604.496233:0:10130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b8907224a00 already unused, calling callback (ffffffffc0fb0260) 00010000:00010000:1.0:1777022604.496239:0:10130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8b8907e85800 lock: 000000001fee7b9c/0x458a939de7841dd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400010000 nid: local remote: 0x72ae7b78094e4ba5 expref: -99 pid: 10187 timeout: 0 lvb_type: 1 lru_score: 24 lru_type: 1 00010000:00010000:1.0:1777022604.496350:0:10130:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8b8907e85800 lock: 000000001fee7b9c/0x458a939de7841dd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400010020 nid: local remote: 0x72ae7b78094e4ba5 expref: -99 pid: 10187 timeout: 0 lvb_type: 1 lru_score: 24 lru_type: 1 00010000:00010000:1.0:1777022604.496358:0:10130:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777022604.496380:0:10130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8b8907e85800 lock: 000000001fee7b9c/0x458a939de7841dd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400010020 nid: local remote: 0x72ae7b78094e4ba5 expref: -99 pid: 10187 timeout: 0 lvb_type: 1 lru_score: 24 lru_type: 1 00010000:00010000:1.0:1777022604.496387:0:10130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8b8907e85800 lock: 000000001fee7b9c/0x458a939de7841dd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400010020 nid: local remote: 0x72ae7b78094e4ba5 expref: -99 pid: 10187 timeout: 0 lvb_type: 1 lru_score: 24 lru_type: 1 00010000:00010000:1.0:1777022604.496408:0:10130:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777022604.496410:0:10130:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777022604.496412:0:10130:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777022604.496427:0:2377:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8b8909c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2377:1863342816192384:192.168.202.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777022604.505141:0:2377:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8b8909c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:392c2d7e-e97b-4adb-b645-942dabe5c136:2377:1863342816192384:192.168.202.133@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777022604.551375:0:5458:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 47 lines, 47 kept, 0 dropped, 0 bad.