00010000:00010000:0.0F:1715205872.723893:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1715205873.725880:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205874.667369:0:10461:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test 2: Write with a seek, append, read from a single mountpoint ========================================================== 18:04:34 (1715205874) 00000080:00200000:3.0F:1715205874.706331:0:10481:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:3.0:1715205874.706357:0:10481:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205874.706404:0:10481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706413:0:10481:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706420:0:10481:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10481 initiator: MDT0 00000100:00100000:3.0:1715205874.706434:0:10481:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012ab45840 going to sleep for 0 seconds 00000100:00100000:3.0:1715205874.706444:0:10481:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e6d80 pname:cluuid:pid:xid:nid:opc:job dd:4f93b71f-777f-44ae-ae8f-53d858e20398:10481:1798523513227136:192.168.204.135@tcp:101:dd.0 00010000:00010000:3.0:1715205874.706453:0:10481:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706458:0:10481:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706463:0:10481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706469:0:10481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706473:0:10481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706478:0:10481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa95eac0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:3.0:1715205874.706481:0:10481:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706487:0:10481:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706500:0:10481:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706505:0:10481:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205874.706510:0:10481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.706515:0:10481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95eac0/0x68b86d4dd46f4c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 10481 initiator: MDT0 00000080:00020000:3.0:1715205874.706533:0:10481:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715205874.711981:0:10481:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:3.0:1715205874.711996:0:10481:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205874.712023:0:10481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712029:0:10481:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712034:0:10481:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10481 initiator: MDT0 00000100:00100000:3.0:1715205874.712043:0:10481:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012ab45840 going to sleep for 0 seconds 00000100:00100000:3.0:1715205874.712049:0:10481:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e6d80 pname:cluuid:pid:xid:nid:opc:job dd:4f93b71f-777f-44ae-ae8f-53d858e20398:10481:1798523513227200:192.168.204.135@tcp:101:dd.0 00010000:00010000:3.0:1715205874.712055:0:10481:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712059:0:10481:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712062:0:10481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712081:0:10481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712085:0:10481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712088:0:10481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa95ed00 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:3.0:1715205874.712090:0:10481:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712093:0:10481:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712097:0:10481:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712100:0:10481:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205874.712103:0:10481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 10481 initiator: MDT0 00010000:00010000:3.0:1715205874.712105:0:10481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ed00/0x68b86d4dd46f4c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 10481 initiator: MDT0 00000080:00020000:3.0:1715205874.712118:0:10481:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715205874.727933:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205875.005082:0:10614:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-dom test_2: @@@@@@ FAIL: test_2 failed with 1 Debug log: 45 lines, 45 kept, 0 dropped, 0 bad.